2024-08-17T02:16:54.685 INFO:root:teuthology version: 1.2.0 2024-08-17T02:16:54.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:16:54.813 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858284' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpZqRMUpRkaPJY4TLpIHSZnRbOwtnPIXlBj/0kxTd5p+2nGMN1uO9qKEj/Q8f/LPkATR2E95kbExOBXg6IzxcQ= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh56+4m3AtqHR+h4Mt/cq3eKCmiwtWudUgvZMPlYyJIBrWmHriKHd95AURsZn02TiJSMINWYx3hU9SUREBrLSA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:10:27 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:16:54.813 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:16:54.814 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:16:54.814 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:16:54.815 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:16:54.837 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:16:54.837 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:16:54.837 INFO:teuthology.packaging:ref: None 2024-08-17T02:16:54.837 INFO:teuthology.packaging:tag: None 2024-08-17T02:16:54.837 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:16:54.837 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:16:54.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:16:54.979 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:16:54.981 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:16:54.987 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:16:54.987 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:16:55.033 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:16:55.050 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:16:55.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:16:55.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:12:02.800585', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpZqRMUpRkaPJY4TLpIHSZnRbOwtnPIXlBj/0kxTd5p+2nGMN1uO9qKEj/Q8f/LPkATR2E95kbExOBXg6IzxcQ='} 2024-08-17T02:16:55.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:12:02.798668', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh56+4m3AtqHR+h4Mt/cq3eKCmiwtWudUgvZMPlYyJIBrWmHriKHd95AURsZn02TiJSMINWYx3hU9SUREBrLSA='} 2024-08-17T02:16:55.187 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:16:55.246 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:16:55.246 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:16:55.246 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:16:55.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6cbed3ac0>, signals=[15]) 2024-08-17T02:16:55.344 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:16:55.379 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:16:55.379 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:16:55.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:55.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:16:55.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:55.543 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:16:55.550 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-08-17T02:16:55.568 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-08-17T02:16:55.568 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:16:55.625 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:16:55.626 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:16:55.627 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-08-17T02:16:55.655 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-08-17T02:16:55.674 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-08-17T02:16:55.675 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-08-17T02:16:55.733 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-08-17T02:16:55.733 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-08-17T02:16:55.733 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-08-17T02:16:55.733 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:16:55.734 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:16:55.735 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:16:55.735 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:16:55.735 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-08-17T02:16:55.755 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:16:55.764 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:16:55.808 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:16:55.809 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:16:55.811 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:16:55.826 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:16:55.832 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:16:55.832 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:16:55.868 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:16:55.906 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:16:56.005 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:16:56.019 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:16:56.019 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:16:56.019 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:16:56.019 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:16:56.020 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:16:56.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:56.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:16:56.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:56.044 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:16:56.200 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:16:56.200 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:16:56.200 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-08-17T02:16:56.202 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:16:56.202 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:16:56.202 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-08-17T02:16:56.219 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:16:56.219 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:16:56.219 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:16:56.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum upgrade -y linux-firmware 2024-08-17T02:16:56.221 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:16:56.221 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:16:56.221 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:16:56.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2024-08-17T02:16:58.283 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-08-17T02:16:59.720 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-08-17T02:17:00.842 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-08-17T02:17:01.763 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:17:05.342 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.6 MB 00:00 2024-08-17T02:17:06.222 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.6 MB 00:00 2024-08-17T02:17:06.976 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 18 kB 00:00 2024-08-17T02:17:07.839 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 18 kB 00:00 2024-08-17T02:17:07.855 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-17T02:17:08.751 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-17T02:17:13.277 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-17T02:17:14.107 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:17:15.311 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-08-17T02:17:15.319 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 1 Package 2024-08-17T02:17:15.320 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:17:15.321 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 383 M 2024-08-17T02:17:15.321 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-08-17T02:17:16.170 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout: Package Architecture Version Repository Size 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 1 Package 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 383 M 2024-08-17T02:17:16.179 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-08-17T02:17:25.063 INFO:teuthology.orchestra.run.smithi177.stdout:linux-firmware-20240716-145.el9.noarch.rpm 40 MB/s | 383 MB 00:09 2024-08-17T02:17:25.063 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:17:25.064 INFO:teuthology.orchestra.run.smithi177.stdout:Total 39 MB/s | 383 MB 00:09 2024-08-17T02:17:27.392 INFO:teuthology.orchestra.run.smithi110.stdout:linux-firmware-20240716-145.el9.noarch.rpm 34 MB/s | 383 MB 00:11 2024-08-17T02:17:27.392 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:17:27.392 INFO:teuthology.orchestra.run.smithi110.stdout:Total 34 MB/s | 383 MB 00:11 2024-08-17T02:17:28.152 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-08-17T02:17:28.311 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-08-17T02:17:28.311 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-08-17T02:17:30.481 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-08-17T02:17:30.578 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-08-17T02:17:30.578 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-08-17T02:17:31.595 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-08-17T02:17:31.595 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-08-17T02:17:33.836 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-08-17T02:17:33.837 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-08-17T02:17:40.675 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-08-17T02:17:41.550 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:17:41.643 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:42.347 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:42.347 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:17:43.100 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:43.100 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:17:43.100 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-08-17T02:17:43.101 INFO:teuthology.orchestra.run.smithi177.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:17:43.101 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:17:43.101 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-08-17T02:17:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-08-17T02:17:43.432 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:17:43.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:17:43.584 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:17:43.584 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:17:43.588 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi177.front.sepia.ceph.com to complete... 2024-08-17T02:17:43.854 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:17:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:17:45.296 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-08-17T02:17:45.635 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:17:45.635 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:17:45.777 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:17:45.778 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:17:45.780 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-08-17T02:17:51.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17 02:17:51 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:17:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:FINISHED --2024-08-17 02:17:51-- 2024-08-17T02:17:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:Total wall clock time: 7.9s 2024-08-17T02:17:51.506 INFO:teuthology.orchestra.run.smithi177.stderr:Downloaded: 1 files, 344M in 7.6s (45.2 MB/s) 2024-08-17T02:17:51.508 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:17:51.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:17:53.570 INFO:teuthology.orchestra.run.smithi177.stdout:Verifying... ######################################## 2024-08-17T02:17:53.686 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing... ######################################## 2024-08-17T02:17:53.736 INFO:teuthology.orchestra.run.smithi177.stdout:Updating / installing... 2024-08-17T02:17:56.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17 02:17:56 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:17:56.755 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-08-17 02:17:56-- 2024-08-17T02:17:56.755 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 11s 2024-08-17T02:17:56.755 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 344M in 11s (32.6 MB/s) 2024-08-17T02:17:56.758 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:17:56.758 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:17:58.826 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2024-08-17T02:17:58.868 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2024-08-17T02:17:58.917 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2024-08-17T02:18:01.823 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:18:06.953 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:18:41.776 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:18:41.777 DEBUG:teuthology.orchestra.run.smithi177:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:18:41.867 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:18:41.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:18:41.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:18:41.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:18:41.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:18:41.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:18:41.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:18:41.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:18:41.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:18:41.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:18:41.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:18:41.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:18:41.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:18:41.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:18:41.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:18:41.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:18:41.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:18:41.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:18:41.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:18:41.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:18:41.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:18:41.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:18:41.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:18:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:18:41.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:18:41.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:18:41.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:18:41.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:18:41.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:18:41.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:18:41.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:18:41.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:18:41.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:18:41.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:18:41.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:18:41.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:18:41.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:18:41.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:18:41.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:18:41.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:18:41.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:18:41.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:18:41.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:18:41.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:18:41.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:18:41.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:18:41.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:18:41.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:18:41.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:18:41.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:18:41.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:18:41.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:18:41.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:18:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:18:41.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:18:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:18:41.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:18:41.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:18:41.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:18:41.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:18:41.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:18:41.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:18:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:18:41.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:18:41.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:18:41.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:18:41.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:18:41.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:18:41.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:18:41.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:18:41.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:18:41.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:18:41.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:18:41.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:18:41.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:18:41.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:18:41.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:18:41.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:18:41.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:18:41.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:18:41.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:18:41.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:18:41.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:18:41.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:18:41.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:18:41.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:18:41.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:18:41.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:18:41.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:18:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:18:41.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:18:41.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:18:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:18:41.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:18:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:18:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:18:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:18:41.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:18:41.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:18:41.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:18:41.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:18:41.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:18:41.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:18:41.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:18:41.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:18:41.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:18:41.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:18:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:18:41.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:18:41.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:18:41.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:18:41.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:18:41.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:18:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:18:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:18:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:18:41.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:18:41.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:18:41.964 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:18:41.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:18:41.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:18:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:18:41.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:18:41.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:18:41.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:18:41.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:18:41.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:18:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:18:41.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:18:41.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:18:41.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:18:41.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:18:41.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:18:41.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:18:41.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:18:41.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:18:41.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:18:41.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:18:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:18:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:18:41.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:18:41.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:18:41.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:18:41.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:18:41.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:18:41.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:18:41.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:18:41.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:18:41.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:18:41.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:18:41.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:18:41.997 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:18:41.998 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:18:41.999 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:18:42.000 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:18:42.001 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:18:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:18:42.003 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:18:42.004 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:18:42.005 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:18:42.006 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:18:42.007 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:18:42.008 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:18:42.009 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:18:42.010 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:18:42.011 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:18:42.012 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:18:42.013 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:18:42.014 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:18:42.015 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:18:42.016 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:18:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:18:42.018 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:18:42.019 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:18:42.020 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:18:42.021 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:18:42.022 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:18:42.023 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:18:42.024 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:18:42.025 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:18:42.026 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:18:42.027 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:18:42.028 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:18:42.029 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:18:42.030 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:18:42.031 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:18:42.031 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:18:42.031 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:18:42.031 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:18:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:18:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:18:42.036 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:18:42.037 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:18:42.038 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:18:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:18:42.040 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:18:42.041 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:18:42.041 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:18:42.041 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:18:42.041 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:18:42.041 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:18:42.042 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:18:42.043 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:18:42.043 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:18:42.043 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:18:42.043 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:18:42.048 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:42.048 DEBUG:teuthology.orchestra.run.smithi177:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:18:42.072 INFO:teuthology.orchestra.run.smithi177.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:42.073 INFO:teuthology.orchestra.run.smithi177.stdout: fi 2024-08-17T02:18:42.074 INFO:teuthology.orchestra.run.smithi177.stdout:done 2024-08-17T02:18:42.074 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:18:42.074 INFO:teuthology.orchestra.run.smithi177.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:18:42.074 INFO:teuthology.orchestra.run.smithi177.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:42.074 INFO:teuthology.orchestra.run.smithi177.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2024-08-17T02:18:42.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-08-17T02:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-08-17T02:18:42.147 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 68.el9 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8264254 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:18:42.148 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:18:42.149 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:18:42.151 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:18:42.152 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:42.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:18:42.732 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-08-17T02:18:44.109 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:18:44.144 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-08-17T02:18:44.147 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-08-17T02:18:44.163 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.okV0tSp3K2 2024-08-17T02:18:44.164 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.okV0tSp3K2 2024-08-17T02:18:44.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.okV0tSp3K2 2024-08-17T02:18:44.382 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.okV0tSp3K2 is 6KB 2024-08-17T02:18:44.437 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.okV0tSp3K2 2024-08-17T02:18:44.451 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:18:44.512 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:18:44.512 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:18:44.512 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:18:44.513 INFO:teuthology.orchestra.run.smithi177.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:18:44.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:44.668 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-08-17T02:18:47.029 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:18:47.030 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:18:47.116 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:18:47.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:18:47.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:18:47.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:18:47.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:18:47.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:18:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:18:47.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:18:47.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:18:47.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:18:47.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:18:47.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:18:47.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:18:47.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:18:47.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:18:47.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:18:47.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:18:47.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:18:47.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:18:47.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:18:47.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:18:47.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:18:47.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:18:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:18:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:18:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:18:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:18:47.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:18:47.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:18:47.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:18:47.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:18:47.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:18:47.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:18:47.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:18:47.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:18:47.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:18:47.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:18:47.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:18:47.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:18:47.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:18:47.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:18:47.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:18:47.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:18:47.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:18:47.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:18:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:18:47.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:18:47.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:18:47.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:18:47.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:18:47.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:18:47.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:18:47.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:18:47.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:18:47.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:18:47.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:18:47.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:18:47.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:18:47.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:18:47.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:18:47.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:18:47.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:18:47.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:18:47.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:18:47.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:18:47.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:18:47.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:18:47.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:18:47.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:18:47.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:18:47.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:18:47.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:18:47.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:18:47.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:18:47.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:18:47.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:18:47.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:18:47.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:18:47.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:18:47.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:18:47.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:18:47.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:18:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:18:47.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:18:47.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:18:47.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:18:47.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:18:47.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:18:47.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:18:47.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:18:47.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:18:47.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:18:47.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:18:47.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:18:47.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:18:47.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:18:47.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:18:47.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:18:47.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:18:47.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:18:47.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:18:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:18:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:18:47.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:18:47.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:18:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:18:47.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:18:47.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:18:47.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:18:47.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:18:47.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:18:47.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:18:47.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:18:47.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:18:47.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:18:47.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:18:47.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:18:47.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:18:47.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:18:47.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:18:47.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:18:47.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:18:47.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:18:47.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:18:47.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:18:47.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:18:47.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:18:47.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:18:47.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:18:47.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:18:47.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:18:47.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:18:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:18:47.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:18:47.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:18:47.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:18:47.228 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:18:47.229 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:18:47.230 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:18:47.231 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:18:47.232 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:18:47.233 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:18:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:18:47.235 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:18:47.236 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:18:47.237 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:18:47.238 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:18:47.239 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:18:47.240 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:18:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:18:47.242 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:18:47.243 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:18:47.244 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:18:47.245 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:18:47.246 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:18:47.247 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:18:47.248 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:18:47.249 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:18:47.250 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:18:47.251 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:18:47.252 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:18:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:18:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:18:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:18:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:18:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:18:47.254 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:18:47.254 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:18:47.254 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:18:47.254 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:18:47.254 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:18:47.255 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:18:47.256 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:18:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:18:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:18:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:18:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:18:47.257 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:18:47.258 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:18:47.259 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:18:47.260 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:18:47.261 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:18:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:18:47.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:18:47.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:18:47.263 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:18:47.264 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:18:47.265 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:18:47.266 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:18:47.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:18:47.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:18:47.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:18:47.270 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:18:47.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:18:47.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:18:47.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:18:47.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:18:47.271 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:18:47.272 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:18:47.273 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:18:47.274 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:18:47.274 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:18:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:18:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:18:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:18:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:18:47.275 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:18:47.276 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:18:47.277 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:18:47.278 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:18:47.279 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:18:47.280 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:18:47.281 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:18:47.282 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:18:47.283 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:18:47.284 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:18:47.285 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:18:47.286 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:18:47.287 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:18:47.288 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:18:47.289 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:18:47.290 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:18:47.291 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:18:47.292 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:18:47.293 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:18:47.294 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:18:47.295 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:18:47.296 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:18:47.297 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:18:47.298 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:18:47.299 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:18:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:18:47.301 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:18:47.302 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:18:47.303 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:18:47.304 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:18:47.305 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:18:47.306 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:18:47.307 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:18:47.308 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:18:47.309 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:18:47.310 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:18:47.314 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.314 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: fi 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.338 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-08-17T02:18:47.339 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-08-17T02:18:47.410 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:18:47.411 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-08-17T02:18:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:18:47.412 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:18:47.413 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:18:47.413 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:47.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:18:47.971 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-08-17T02:18:49.353 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:18:49.371 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-08-17T02:18:49.374 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-08-17T02:18:49.389 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.fqLZoatD9J 2024-08-17T02:18:49.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fqLZoatD9J 2024-08-17T02:18:49.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.fqLZoatD9J 2024-08-17T02:18:49.603 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.fqLZoatD9J is 6KB 2024-08-17T02:18:49.651 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.fqLZoatD9J 2024-08-17T02:18:49.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:18:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:18:49.726 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:18:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:18:49.727 INFO:teuthology.orchestra.run.smithi110.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:18:49.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:18:49.876 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-08-17T02:19:14.694 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:19:14.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:19:14.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:19.884 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:19:19.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:19:19.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:33.219 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-08-17T02:19:38.339 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-08-17T02:19:42.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:19:42.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:47.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:19:47.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:19:50.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-08-17T02:20:02.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:20:02.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:34.326 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-08-17T02:20:34.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:20:34.850 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:20:34.851 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-08-17T02:20:34.885 INFO:teuthology.orchestra.run.smithi110.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:20:34.886 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:20:34.886 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:20:34.886 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:20:35.887 DEBUG:teuthology.parallel:result is None 2024-08-17T02:20:42.226 DEBUG:teuthology.orchestra.remote:timed out 2024-08-17T02:20:54.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:20:54.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:20:54.654 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-08-17T02:20:55.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:20:55.144 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:20:55.145 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-08-17T02:20:55.179 INFO:teuthology.orchestra.run.smithi177.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:20:55.179 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:20:55.179 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:20:55.179 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:20:56.184 DEBUG:teuthology.parallel:result is None 2024-08-17T02:20:56.184 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:20:56.195 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:20:56.196 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:20:56.202 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:20:56.240 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:20:56.247 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:20:56.282 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:20:56.282 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:20:56.287 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:20:56.358 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:20:56.365 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:20:56.365 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:20:56.371 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:20:56.473 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:20:56.485 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:20:56.514 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:20:56.528 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:20:56.535 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:20:56.542 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:20:56.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:20:56.546 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:20:56.602 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:20:56.662 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:20:56.662 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:20:56.667 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:20:56.701 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:20:56.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:20:56.880 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:20:56.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:20:57.013 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:20:57.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:20:57.068 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:20:57.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:20:57.224 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:20:57.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:20:57.356 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:20:57.357 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:20:57.410 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-08-17T02:20:57.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-08-17T02:20:57.492 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:20:57.527 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:20:57.907 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:20:57.917 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:20:57.917 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:20:57.962 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:20:58.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-08-17T02:20:58.135 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-08-17T02:20:58.136 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-08-17T02:20:58.225 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-08-17T02:20:58.228 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:20:58.228 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-08-17T02:20:58.272 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-08-17T02:20:58.272 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-08-17T02:20:58.313 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-08-17T02:20:58.313 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi110.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:20:58.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:20:58.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:20:58.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:20:58.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:20:58.429 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:20:58.429 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:20:58.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:20:58.540 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:20:58.550 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-17T02:20:58.553 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-17T02:20:58.676 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:20:58.689 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:20:58.690 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi110.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:26:29.487 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi110.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-08-17T02:26:29.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:26:29.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:26:29.581 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-08-17T02:26:29.688 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-08-17T02:26:29.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:26:29.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:26:29.775 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-08-17T02:26:29.881 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-08-17T02:26:29.881 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:26:29.892 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:26:29.892 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:26:29.893 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:26:29.897 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:26:29.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:26:29.954 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:26:29.981 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:26:29.984 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:26:30.010 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:26:30.034 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-08-17T02:26:30.058 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-08-17T02:26:30.061 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-08-17T02:26:30.086 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-08-17T02:26:30.087 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:26:30.114 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:26:30.117 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:26:30.143 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:26:30.205 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:26:30.211 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:26:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-08-17T02:26:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.212 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.243 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:26:30.249 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:26:30.249 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-08-17T02:26:30.250 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.250 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.250 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.250 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:26:30.251 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:26:30.262 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:26:30.263 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:26:30.263 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:26:30.263 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:26:30.272 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:26:30.272 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:26:30.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:26:30.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:26:30.966 INFO:teuthology.orchestra.run.smithi110.stdout:Last metadata expiration check: 0:01:14 ago on Sat 17 Aug 2024 02:25:16 AM UTC. 2024-08-17T02:26:30.979 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:15 ago on Sat 17 Aug 2024 02:25:15 AM UTC. 2024-08-17T02:26:31.053 INFO:teuthology.orchestra.run.smithi110.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:26:31.070 INFO:teuthology.orchestra.run.smithi177.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:26:31.096 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-08-17T02:26:31.097 INFO:teuthology.orchestra.run.smithi110.stdout:Nothing to do. 2024-08-17T02:26:31.097 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-08-17T02:26:31.111 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-08-17T02:26:31.113 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-08-17T02:26:31.113 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-08-17T02:26:31.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:26:31.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:of the main distribution, and quality may vary. 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:, 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:and packages are not held to any quality or security level. 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-08-17T02:26:31.432 INFO:teuthology.orchestra.run.smithi177.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:26:31.433 INFO:teuthology.orchestra.run.smithi177.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:26:31.435 INFO:teuthology.orchestra.run.smithi110.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:26:31.435 INFO:teuthology.orchestra.run.smithi110.stderr:of the main distribution, and quality may vary. 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:, 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:and packages are not held to any quality or security level. 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:26:31.436 INFO:teuthology.orchestra.run.smithi110.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:26:31.534 INFO:teuthology.orchestra.run.smithi177.stdout:Repository successfully enabled. 2024-08-17T02:26:31.535 INFO:teuthology.orchestra.run.smithi110.stdout:Repository successfully enabled. 2024-08-17T02:26:31.578 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:26:31.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:31.584 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:26:31.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:26:31.719 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:26:31.720 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:26:31.752 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:26:31.752 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:26:31.828 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:26:31.828 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:26:31.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:26:31.860 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:26:31.860 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:26:31.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:26:31.884 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:26:31.884 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:26:31.916 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:26:31.917 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:26:31.981 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:26:32.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:26:32.059 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:26:32.090 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:26:32.114 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-08-17T02:26:32.117 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-08-17T02:26:32.145 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-08-17T02:26:32.148 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-08-17T02:26:32.393 INFO:teuthology.orchestra.run.smithi110.stdout:45 files removed 2024-08-17T02:26:32.418 INFO:teuthology.orchestra.run.smithi177.stdout:45 files removed 2024-08-17T02:26:32.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:26:32.450 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:26:33.129 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 227 kB/s | 77 kB 00:00 2024-08-17T02:26:33.137 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 239 kB/s | 77 kB 00:00 2024-08-17T02:26:33.447 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-08-17T02:26:33.454 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-08-17T02:26:33.764 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 6.6 kB/s | 1.8 kB 00:00 2024-08-17T02:26:33.781 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 6.0 kB/s | 1.8 kB 00:00 2024-08-17T02:26:34.014 INFO:teuthology.orchestra.run.smithi177.stdout:Copr repo for el9 owned by ceph 36 kB/s | 7.6 kB 00:00 2024-08-17T02:26:34.057 INFO:teuthology.orchestra.run.smithi110.stdout:Copr repo for el9 owned by ceph 32 kB/s | 7.6 kB 00:00 2024-08-17T02:26:34.730 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:26:35.465 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.2 MB 00:01 2024-08-17T02:26:36.624 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-08-17T02:26:38.675 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-08-17T02:26:42.416 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.6 MB 00:01 2024-08-17T02:26:43.125 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.6 MB 00:00 2024-08-17T02:26:43.950 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 18 kB 00:00 2024-08-17T02:26:44.884 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 18 kB 00:00 2024-08-17T02:26:44.955 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-08-17T02:26:46.064 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 21 MB/s | 22 MB 00:01 2024-08-17T02:26:51.169 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-08-17T02:26:52.370 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-17T02:26:53.723 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:26:53.723 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:26:53.734 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:26:53.735 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:26:53.735 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:26:53.736 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:26:53.738 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:26:53.740 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:26:53.741 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:26:53.800 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:26:53.819 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:26:53.820 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:26:53.821 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:26:53.822 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:26:53.823 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:26:53.824 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:26:53.825 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:26:53.826 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:26:53.827 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:26:53.828 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:26:53.829 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================= 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout:Install 121 Packages 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 12 Packages 2024-08-17T02:26:53.830 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:26:53.831 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 206 M 2024-08-17T02:26:53.831 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-08-17T02:26:54.712 INFO:teuthology.orchestra.run.smithi177.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 38 kB/s | 6.5 kB 00:00 2024-08-17T02:26:54.874 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:26:54.875 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:26:54.886 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:26:54.886 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:26:54.887 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:26:54.888 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:26:54.890 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:26:54.892 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:26:54.893 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:26:54.904 INFO:teuthology.orchestra.run.smithi177.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.1 MB/s | 813 kB 00:00 2024-08-17T02:26:54.952 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:26:54.965 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:26:54.966 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:26:54.967 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:26:54.968 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:26:54.969 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:26:54.970 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:26:54.971 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:26:54.972 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:26:54.973 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:26:54.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:26:54.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:26:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:26:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:26:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:26:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:26:54.978 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout:Installing weak dependencies: 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout:======================================================================================= 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout:Install 121 Packages 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 12 Packages 2024-08-17T02:26:54.979 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:26:54.980 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 206 M 2024-08-17T02:26:54.980 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-08-17T02:26:55.020 INFO:teuthology.orchestra.run.smithi177.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 10 MB/s | 5.0 MB 00:00 2024-08-17T02:26:55.045 INFO:teuthology.orchestra.run.smithi177.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 971 kB/s | 137 kB 00:00 2024-08-17T02:26:55.163 INFO:teuthology.orchestra.run.smithi177.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 2.1 MB 00:00 2024-08-17T02:26:55.230 INFO:teuthology.orchestra.run.smithi177.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 7.7 MB/s | 1.4 MB 00:00 2024-08-17T02:26:55.438 INFO:teuthology.orchestra.run.smithi177.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 14 MB/s | 3.9 MB 00:00 2024-08-17T02:26:55.596 INFO:teuthology.orchestra.run.smithi110.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 24 kB/s | 6.5 kB 00:00 2024-08-17T02:26:55.764 INFO:teuthology.orchestra.run.smithi177.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 18 MB/s | 22 MB 00:01 2024-08-17T02:26:55.771 INFO:teuthology.orchestra.run.smithi110.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.5 MB/s | 813 kB 00:00 2024-08-17T02:26:55.814 INFO:teuthology.orchestra.run.smithi177.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 508 kB/s | 25 kB 00:00 2024-08-17T02:26:55.847 INFO:teuthology.orchestra.run.smithi110.stdout:(3/133): ceph-immutable-object-cache-17.2.7-137 1.8 MB/s | 137 kB 00:00 2024-08-17T02:26:55.939 INFO:teuthology.orchestra.run.smithi110.stdout:(4/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 8.1 MB/s | 5.0 MB 00:00 2024-08-17T02:26:56.214 INFO:teuthology.orchestra.run.smithi110.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 5.7 MB/s | 2.1 MB 00:00 2024-08-17T02:26:56.389 INFO:teuthology.orchestra.run.smithi177.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 15 MB/s | 14 MB 00:00 2024-08-17T02:26:56.465 INFO:teuthology.orchestra.run.smithi110.stdout:(6/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 16 MB/s | 3.9 MB 00:00 2024-08-17T02:26:56.573 INFO:teuthology.orchestra.run.smithi177.stdout:(11/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 15 MB 00:01 2024-08-17T02:26:56.614 INFO:teuthology.orchestra.run.smithi177.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 954 kB/s | 215 kB 00:00 2024-08-17T02:26:56.640 INFO:teuthology.orchestra.run.smithi177.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 375 kB/s | 25 kB 00:00 2024-08-17T02:26:56.673 INFO:teuthology.orchestra.run.smithi177.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 11 MB/s | 636 kB 00:00 2024-08-17T02:26:56.699 INFO:teuthology.orchestra.run.smithi177.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:26:56.716 INFO:teuthology.orchestra.run.smithi177.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 3.0 MB/s | 126 kB 00:00 2024-08-17T02:26:56.765 INFO:teuthology.orchestra.run.smithi110.stdout:(7/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 1.7 MB/s | 1.4 MB 00:00 2024-08-17T02:26:56.791 INFO:teuthology.orchestra.run.smithi177.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 4.9 MB/s | 458 kB 00:00 2024-08-17T02:26:56.883 INFO:teuthology.orchestra.run.smithi177.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 491 kB/s | 45 kB 00:00 2024-08-17T02:26:56.959 INFO:teuthology.orchestra.run.smithi177.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 1.6 MB/s | 120 kB 00:00 2024-08-17T02:26:57.051 INFO:teuthology.orchestra.run.smithi177.stdout:(20/133): librgw2-17.2.7-1375.g2577e813.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-17T02:26:57.076 INFO:teuthology.orchestra.run.smithi177.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 1.5 MB/s | 182 kB 00:00 2024-08-17T02:26:57.118 INFO:teuthology.orchestra.run.smithi177.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 5.4 MB/s | 369 kB 00:00 2024-08-17T02:26:57.151 INFO:teuthology.orchestra.run.smithi177.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 4.5 MB/s | 344 kB 00:00 2024-08-17T02:26:57.177 INFO:teuthology.orchestra.run.smithi177.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:26:57.202 INFO:teuthology.orchestra.run.smithi177.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:26:57.277 INFO:teuthology.orchestra.run.smithi177.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 2.2 MB/s | 165 kB 00:00 2024-08-17T02:26:57.357 INFO:teuthology.orchestra.run.smithi110.stdout:(8/133): ceph-osd-17.2.7-1375.g2577e813.el9.x86 17 MB/s | 15 MB 00:00 2024-08-17T02:26:57.361 INFO:teuthology.orchestra.run.smithi177.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 16 MB/s | 2.9 MB 00:00 2024-08-17T02:26:57.386 INFO:teuthology.orchestra.run.smithi177.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 224 kB/s | 24 kB 00:00 2024-08-17T02:26:57.412 INFO:teuthology.orchestra.run.smithi177.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.4 MB/s | 124 kB 00:00 2024-08-17T02:26:57.415 INFO:teuthology.orchestra.run.smithi110.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 434 kB/s | 25 kB 00:00 2024-08-17T02:26:57.679 INFO:teuthology.orchestra.run.smithi177.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 11 MB/s | 3.4 MB 00:00 2024-08-17T02:26:57.771 INFO:teuthology.orchestra.run.smithi177.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.6 MB/s | 240 kB 00:00 2024-08-17T02:26:57.863 INFO:teuthology.orchestra.run.smithi177.stdout:(32/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 519 kB/s | 47 kB 00:00 2024-08-17T02:26:57.954 INFO:teuthology.orchestra.run.smithi177.stdout:(33/133): ceph-mgr-diskprediction-local-17.2.7- 14 MB/s | 7.4 MB 00:00 2024-08-17T02:26:57.980 INFO:teuthology.orchestra.run.smithi177.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 125 kB/s | 15 kB 00:00 2024-08-17T02:26:58.022 INFO:teuthology.orchestra.run.smithi177.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.9 MB/s | 269 kB 00:00 2024-08-17T02:26:58.055 INFO:teuthology.orchestra.run.smithi177.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:26:58.089 INFO:teuthology.orchestra.run.smithi177.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 272 kB/s | 18 kB 00:00 2024-08-17T02:26:58.239 INFO:teuthology.orchestra.run.smithi177.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-08-17T02:26:58.357 INFO:teuthology.orchestra.run.smithi177.stdout:(39/133): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-08-17T02:26:58.390 INFO:teuthology.orchestra.run.smithi177.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-08-17T02:26:58.465 INFO:teuthology.orchestra.run.smithi177.stdout:(41/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-17T02:26:58.507 INFO:teuthology.orchestra.run.smithi177.stdout:(42/133): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-08-17T02:26:58.532 INFO:teuthology.orchestra.run.smithi177.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-17T02:26:58.566 INFO:teuthology.orchestra.run.smithi177.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-17T02:26:58.600 INFO:teuthology.orchestra.run.smithi177.stdout:(45/133): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-08-17T02:26:58.625 INFO:teuthology.orchestra.run.smithi177.stdout:(46/133): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-17T02:26:58.965 INFO:teuthology.orchestra.run.smithi110.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 6.4 MB/s | 14 MB 00:02 2024-08-17T02:26:59.117 INFO:teuthology.orchestra.run.smithi177.stdout:(47/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:26:59.184 INFO:teuthology.orchestra.run.smithi177.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 328 kB/s | 22 kB 00:00 2024-08-17T02:26:59.207 INFO:teuthology.orchestra.run.smithi110.stdout:(11/133): ceph-common-17.2.7-1375.g2577e813.el9 5.8 MB/s | 22 MB 00:03 2024-08-17T02:26:59.226 INFO:teuthology.orchestra.run.smithi177.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 1.1 MB/s | 689 kB 00:00 2024-08-17T02:26:59.232 INFO:teuthology.orchestra.run.smithi110.stdout:(12/133): cephfs-mirror-17.2.7-1375.g2577e813.e 805 kB/s | 215 kB 00:00 2024-08-17T02:26:59.258 INFO:teuthology.orchestra.run.smithi110.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 500 kB/s | 25 kB 00:00 2024-08-17T02:26:59.268 INFO:teuthology.orchestra.run.smithi177.stdout:(50/133): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-08-17T02:26:59.285 INFO:teuthology.orchestra.run.smithi177.stdout:(51/133): flexiblas-3.0.4-8.el9.x86_64.rpm 561 kB/s | 33 kB 00:00 2024-08-17T02:26:59.308 INFO:teuthology.orchestra.run.smithi110.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 8.3 MB/s | 636 kB 00:00 2024-08-17T02:26:59.310 INFO:teuthology.orchestra.run.smithi177.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-17T02:26:59.333 INFO:teuthology.orchestra.run.smithi110.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.1 MB/s | 163 kB 00:00 2024-08-17T02:26:59.336 INFO:teuthology.orchestra.run.smithi177.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-08-17T02:26:59.350 INFO:teuthology.orchestra.run.smithi110.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.9 MB/s | 126 kB 00:00 2024-08-17T02:26:59.361 INFO:teuthology.orchestra.run.smithi177.stdout:(54/133): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-08-17T02:26:59.386 INFO:teuthology.orchestra.run.smithi177.stdout:(55/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-17T02:26:59.411 INFO:teuthology.orchestra.run.smithi177.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-08-17T02:26:59.417 INFO:teuthology.orchestra.run.smithi110.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 5.3 MB/s | 458 kB 00:00 2024-08-17T02:26:59.453 INFO:teuthology.orchestra.run.smithi177.stdout:(57/133): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-17T02:26:59.476 INFO:teuthology.orchestra.run.smithi110.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 776 kB/s | 45 kB 00:00 2024-08-17T02:26:59.495 INFO:teuthology.orchestra.run.smithi177.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-08-17T02:26:59.521 INFO:teuthology.orchestra.run.smithi177.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-08-17T02:26:59.535 INFO:teuthology.orchestra.run.smithi110.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 2.0 MB/s | 120 kB 00:00 2024-08-17T02:26:59.546 INFO:teuthology.orchestra.run.smithi177.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-08-17T02:26:59.571 INFO:teuthology.orchestra.run.smithi177.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-17T02:26:59.593 INFO:teuthology.orchestra.run.smithi110.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 3.1 MB/s | 182 kB 00:00 2024-08-17T02:26:59.596 INFO:teuthology.orchestra.run.smithi177.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-08-17T02:26:59.663 INFO:teuthology.orchestra.run.smithi177.stdout:(63/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-08-17T02:26:59.702 INFO:teuthology.orchestra.run.smithi110.stdout:(21/133): librgw2-17.2.7-1375.g2577e813.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-17T02:26:59.736 INFO:teuthology.orchestra.run.smithi110.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 2.5 MB/s | 369 kB 00:00 2024-08-17T02:26:59.761 INFO:teuthology.orchestra.run.smithi110.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.8 MB/s | 344 kB 00:00 2024-08-17T02:26:59.780 INFO:teuthology.orchestra.run.smithi177.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-08-17T02:26:59.786 INFO:teuthology.orchestra.run.smithi110.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 2.3 MB/s | 116 kB 00:00 2024-08-17T02:26:59.811 INFO:teuthology.orchestra.run.smithi110.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:26:59.862 INFO:teuthology.orchestra.run.smithi110.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:26:59.864 INFO:teuthology.orchestra.run.smithi177.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-08-17T02:26:59.889 INFO:teuthology.orchestra.run.smithi177.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-08-17T02:26:59.912 INFO:teuthology.orchestra.run.smithi110.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 493 kB/s | 24 kB 00:00 2024-08-17T02:26:59.914 INFO:teuthology.orchestra.run.smithi177.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-17T02:26:59.940 INFO:teuthology.orchestra.run.smithi177.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-08-17T02:26:59.965 INFO:teuthology.orchestra.run.smithi177.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-08-17T02:26:59.971 INFO:teuthology.orchestra.run.smithi110.stdout:(28/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.1 MB/s | 124 kB 00:00 2024-08-17T02:26:59.990 INFO:teuthology.orchestra.run.smithi177.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:27:00.016 INFO:teuthology.orchestra.run.smithi177.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-08-17T02:27:00.125 INFO:teuthology.orchestra.run.smithi177.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:27:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:(29/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 8.4 MB/s | 2.9 MB 00:00 2024-08-17T02:27:00.150 INFO:teuthology.orchestra.run.smithi177.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-08-17T02:27:00.175 INFO:teuthology.orchestra.run.smithi177.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-17T02:27:00.201 INFO:teuthology.orchestra.run.smithi177.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:27:00.226 INFO:teuthology.orchestra.run.smithi177.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-08-17T02:27:00.268 INFO:teuthology.orchestra.run.smithi177.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-08-17T02:27:00.293 INFO:teuthology.orchestra.run.smithi177.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-08-17T02:27:00.318 INFO:teuthology.orchestra.run.smithi177.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-17T02:27:00.344 INFO:teuthology.orchestra.run.smithi177.stdout:(80/133): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-17T02:27:00.427 INFO:teuthology.orchestra.run.smithi177.stdout:(81/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:27:00.453 INFO:teuthology.orchestra.run.smithi177.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-08-17T02:27:00.478 INFO:teuthology.orchestra.run.smithi177.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-17T02:27:00.503 INFO:teuthology.orchestra.run.smithi177.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-08-17T02:27:00.529 INFO:teuthology.orchestra.run.smithi177.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-17T02:27:00.554 INFO:teuthology.orchestra.run.smithi177.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-08-17T02:27:00.588 INFO:teuthology.orchestra.run.smithi110.stdout:(30/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:27:00.646 INFO:teuthology.orchestra.run.smithi177.stdout:(87/133): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2024-08-17T02:27:00.655 INFO:teuthology.orchestra.run.smithi110.stdout:(31/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 4.9 MB/s | 3.4 MB 00:00 2024-08-17T02:27:00.671 INFO:teuthology.orchestra.run.smithi177.stdout:(88/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.1 MB/s | 309 kB 00:00 2024-08-17T02:27:00.680 INFO:teuthology.orchestra.run.smithi110.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 2.6 MB/s | 240 kB 00:00 2024-08-17T02:27:00.696 INFO:teuthology.orchestra.run.smithi177.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-17T02:27:00.706 INFO:teuthology.orchestra.run.smithi110.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 950 kB/s | 47 kB 00:00 2024-08-17T02:27:00.721 INFO:teuthology.orchestra.run.smithi177.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:27:00.731 INFO:teuthology.orchestra.run.smithi110.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 292 kB/s | 15 kB 00:00 2024-08-17T02:27:00.755 INFO:teuthology.orchestra.run.smithi177.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 963 kB/s | 32 kB 00:00 2024-08-17T02:27:00.756 INFO:teuthology.orchestra.run.smithi110.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:27:00.780 INFO:teuthology.orchestra.run.smithi177.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 569 kB/s | 14 kB 00:00 2024-08-17T02:27:00.806 INFO:teuthology.orchestra.run.smithi177.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.8 MB/s | 172 kB 00:00 2024-08-17T02:27:00.807 INFO:teuthology.orchestra.run.smithi110.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.1 MB/s | 83 kB 00:00 2024-08-17T02:27:00.831 INFO:teuthology.orchestra.run.smithi177.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.3 MB/s | 548 kB 00:00 2024-08-17T02:27:00.832 INFO:teuthology.orchestra.run.smithi110.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 242 kB/s | 18 kB 00:00 2024-08-17T02:27:00.865 INFO:teuthology.orchestra.run.smithi177.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:27:00.890 INFO:teuthology.orchestra.run.smithi177.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 4.2 MB/s | 358 kB 00:00 2024-08-17T02:27:00.907 INFO:teuthology.orchestra.run.smithi177.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 255 kB/s | 11 kB 00:00 2024-08-17T02:27:00.924 INFO:teuthology.orchestra.run.smithi177.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 528 kB/s | 18 kB 00:00 2024-08-17T02:27:00.941 INFO:teuthology.orchestra.run.smithi177.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 689 kB/s | 23 kB 00:00 2024-08-17T02:27:00.958 INFO:teuthology.orchestra.run.smithi177.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 577 kB/s | 19 kB 00:00 2024-08-17T02:27:00.984 INFO:teuthology.orchestra.run.smithi177.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-08-17T02:27:01.009 INFO:teuthology.orchestra.run.smithi177.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:27:01.034 INFO:teuthology.orchestra.run.smithi177.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 813 kB/s | 41 kB 00:00 2024-08-17T02:27:01.059 INFO:teuthology.orchestra.run.smithi177.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:27:01.085 INFO:teuthology.orchestra.run.smithi177.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:27:01.110 INFO:teuthology.orchestra.run.smithi177.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:27:01.124 INFO:teuthology.orchestra.run.smithi110.stdout:(38/133): ceph-mgr-diskprediction-local-17.2.7- 7.5 MB/s | 7.4 MB 00:00 2024-08-17T02:27:01.144 INFO:teuthology.orchestra.run.smithi177.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:27:01.169 INFO:teuthology.orchestra.run.smithi177.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 652 kB/s | 16 kB 00:00 2024-08-17T02:27:01.195 INFO:teuthology.orchestra.run.smithi177.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:27:01.220 INFO:teuthology.orchestra.run.smithi177.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:27:01.253 INFO:teuthology.orchestra.run.smithi177.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:27:01.279 INFO:teuthology.orchestra.run.smithi177.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:27:01.304 INFO:teuthology.orchestra.run.smithi177.stdout:(113/133): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-08-17T02:27:01.329 INFO:teuthology.orchestra.run.smithi177.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-08-17T02:27:01.355 INFO:teuthology.orchestra.run.smithi177.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:27:01.380 INFO:teuthology.orchestra.run.smithi177.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.6 MB/s | 90 kB 00:00 2024-08-17T02:27:01.414 INFO:teuthology.orchestra.run.smithi177.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-17T02:27:01.439 INFO:teuthology.orchestra.run.smithi177.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-08-17T02:27:01.481 INFO:teuthology.orchestra.run.smithi177.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-08-17T02:27:01.539 INFO:teuthology.orchestra.run.smithi177.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-17T02:27:01.591 INFO:teuthology.orchestra.run.smithi110.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 102 kB/s | 80 kB 00:00 2024-08-17T02:27:01.740 INFO:teuthology.orchestra.run.smithi177.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:27:01.857 INFO:teuthology.orchestra.run.smithi177.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 9.3 MB/s | 2.9 MB 00:00 2024-08-17T02:27:01.891 INFO:teuthology.orchestra.run.smithi110.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 759 kB/s | 803 kB 00:01 2024-08-17T02:27:01.915 INFO:teuthology.orchestra.run.smithi177.stdout:(123/133): librados2-17.2.7-1375.g2577e813.el9. 7.1 MB/s | 3.1 MB 00:00 2024-08-17T02:27:01.966 INFO:teuthology.orchestra.run.smithi177.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 10 MB/s | 2.3 MB 00:00 2024-08-17T02:27:01.966 INFO:teuthology.orchestra.run.smithi110.stdout:(41/133): libquadmath-11.4.1-3.el9.x86_64.rpm 250 kB/s | 195 kB 00:00 2024-08-17T02:27:02.016 INFO:teuthology.orchestra.run.smithi177.stdout:(125/133): NetworkManager-libnm-1.48.2-2.el9.x8 11 MB/s | 1.8 MB 00:00 2024-08-17T02:27:02.041 INFO:teuthology.orchestra.run.smithi177.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 3.2 MB/s | 247 kB 00:00 2024-08-17T02:27:02.075 INFO:teuthology.orchestra.run.smithi177.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 626 kB/s | 37 kB 00:00 2024-08-17T02:27:02.100 INFO:teuthology.orchestra.run.smithi177.stdout:(128/133): NetworkManager-team-1.48.2-2.el9.x86 221 kB/s | 41 kB 00:00 2024-08-17T02:27:02.126 INFO:teuthology.orchestra.run.smithi177.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 2.4 MB/s | 207 kB 00:00 2024-08-17T02:27:02.151 INFO:teuthology.orchestra.run.smithi177.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 3.4 MB/s | 260 kB 00:00 2024-08-17T02:27:02.226 INFO:teuthology.orchestra.run.smithi177.stdout:(131/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-08-17T02:27:02.268 INFO:teuthology.orchestra.run.smithi177.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-08-17T02:27:02.343 INFO:teuthology.orchestra.run.smithi177.stdout:(133/133): openssl-3.2.2-2.el9.x86_64.rpm 5.6 MB/s | 1.4 MB 00:00 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:27:02.348 INFO:teuthology.orchestra.run.smithi177.stdout:Total 24 MB/s | 206 MB 00:08 2024-08-17T02:27:02.366 INFO:teuthology.orchestra.run.smithi110.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 327 kB/s | 253 kB 00:00 2024-08-17T02:27:02.667 INFO:teuthology.orchestra.run.smithi110.stdout:(43/133): python3-ply-3.11-14.el9.noarch.rpm 152 kB/s | 106 kB 00:00 2024-08-17T02:27:02.876 INFO:teuthology.orchestra.run.smithi110.stdout:(44/133): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-08-17T02:27:03.077 INFO:teuthology.orchestra.run.smithi110.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 191 kB/s | 135 kB 00:00 2024-08-17T02:27:03.293 INFO:teuthology.orchestra.run.smithi110.stdout:(46/133): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-08-17T02:27:03.368 INFO:teuthology.orchestra.run.smithi110.stdout:(47/133): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-08-17T02:27:03.393 INFO:teuthology.orchestra.run.smithi110.stdout:(48/133): python3-requests-2.25.1-8.el9.noarch. 172 kB/s | 125 kB 00:00 2024-08-17T02:27:03.410 INFO:teuthology.orchestra.run.smithi110.stdout:(49/133): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-08-17T02:27:03.444 INFO:teuthology.orchestra.run.smithi110.stdout:(50/133): flexiblas-3.0.4-8.el9.x86_64.rpm 980 kB/s | 33 kB 00:00 2024-08-17T02:27:03.561 INFO:teuthology.orchestra.run.smithi110.stdout:(51/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-08-17T02:27:03.594 INFO:teuthology.orchestra.run.smithi110.stdout:(52/133): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-08-17T02:27:03.612 INFO:teuthology.orchestra.run.smithi110.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-08-17T02:27:03.637 INFO:teuthology.orchestra.run.smithi110.stdout:(54/133): python3-urllib3-1.26.5-6.el9.noarch.r 282 kB/s | 215 kB 00:00 2024-08-17T02:27:03.682 INFO:teuthology.orchestra.run.smithi110.stdout:(55/133): libaio-devel-0.3.111-13.el9.x86_64.rp 128 kB/s | 11 kB 00:00 2024-08-17T02:27:03.704 INFO:teuthology.orchestra.run.smithi110.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-08-17T02:27:03.729 INFO:teuthology.orchestra.run.smithi110.stdout:(57/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-08-17T02:27:03.771 INFO:teuthology.orchestra.run.smithi110.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 614 kB/s | 25 kB 00:00 2024-08-17T02:27:03.805 INFO:teuthology.orchestra.run.smithi110.stdout:(59/133): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-08-17T02:27:03.830 INFO:teuthology.orchestra.run.smithi110.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-08-17T02:27:03.856 INFO:teuthology.orchestra.run.smithi110.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-17T02:27:03.881 INFO:teuthology.orchestra.run.smithi110.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-08-17T02:27:03.915 INFO:teuthology.orchestra.run.smithi110.stdout:(63/133): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-08-17T02:27:04.023 INFO:teuthology.orchestra.run.smithi110.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-08-17T02:27:04.052 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-08-17T02:27:04.115 INFO:teuthology.orchestra.run.smithi110.stdout:(65/133): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-08-17T02:27:04.140 INFO:teuthology.orchestra.run.smithi110.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-08-17T02:27:04.166 INFO:teuthology.orchestra.run.smithi110.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-08-17T02:27:04.191 INFO:teuthology.orchestra.run.smithi110.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 508 kB/s | 26 kB 00:00 2024-08-17T02:27:04.216 INFO:teuthology.orchestra.run.smithi110.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-08-17T02:27:04.241 INFO:teuthology.orchestra.run.smithi110.stdout:(70/133): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-17T02:27:04.262 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-08-17T02:27:04.262 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-08-17T02:27:04.275 INFO:teuthology.orchestra.run.smithi110.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-08-17T02:27:04.384 INFO:teuthology.orchestra.run.smithi110.stdout:(72/133): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-17T02:27:04.409 INFO:teuthology.orchestra.run.smithi110.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-08-17T02:27:04.434 INFO:teuthology.orchestra.run.smithi110.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-08-17T02:27:04.460 INFO:teuthology.orchestra.run.smithi110.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-17T02:27:04.477 INFO:teuthology.orchestra.run.smithi110.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-17T02:27:04.510 INFO:teuthology.orchestra.run.smithi110.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-17T02:27:04.536 INFO:teuthology.orchestra.run.smithi110.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-08-17T02:27:04.553 INFO:teuthology.orchestra.run.smithi110.stdout:(79/133): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-08-17T02:27:04.659 INFO:teuthology.orchestra.run.smithi110.stdout:(80/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-17T02:27:04.678 INFO:teuthology.orchestra.run.smithi110.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 377 kB/s | 54 kB 00:00 2024-08-17T02:27:04.695 INFO:teuthology.orchestra.run.smithi110.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-08-17T02:27:04.729 INFO:teuthology.orchestra.run.smithi110.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-17T02:27:04.754 INFO:teuthology.orchestra.run.smithi110.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:27:04.771 INFO:teuthology.orchestra.run.smithi110.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-17T02:27:04.822 INFO:teuthology.orchestra.run.smithi110.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-08-17T02:27:04.880 INFO:teuthology.orchestra.run.smithi110.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2024-08-17T02:27:04.914 INFO:teuthology.orchestra.run.smithi110.stdout:(88/133): libunwind-1.6.2-1.el9.x86_64.rpm 2.1 MB/s | 67 kB 00:00 2024-08-17T02:27:04.930 INFO:teuthology.orchestra.run.smithi110.stdout:(89/133): liboath-2.6.7-2.el9.x86_64.rpm 457 kB/s | 49 kB 00:00 2024-08-17T02:27:04.947 INFO:teuthology.orchestra.run.smithi110.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-08-17T02:27:04.964 INFO:teuthology.orchestra.run.smithi110.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.9 MB/s | 32 kB 00:00 2024-08-17T02:27:04.981 INFO:teuthology.orchestra.run.smithi110.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 851 kB/s | 14 kB 00:00 2024-08-17T02:27:05.007 INFO:teuthology.orchestra.run.smithi110.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 6.7 MB/s | 172 kB 00:00 2024-08-17T02:27:05.032 INFO:teuthology.orchestra.run.smithi110.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.5 MB/s | 548 kB 00:00 2024-08-17T02:27:05.066 INFO:teuthology.orchestra.run.smithi110.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-17T02:27:05.083 INFO:teuthology.orchestra.run.smithi110.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 649 kB/s | 11 kB 00:00 2024-08-17T02:27:05.108 INFO:teuthology.orchestra.run.smithi110.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-08-17T02:27:05.134 INFO:teuthology.orchestra.run.smithi110.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 350 kB/s | 18 kB 00:00 2024-08-17T02:27:05.161 INFO:teuthology.orchestra.run.smithi110.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 441 kB/s | 23 kB 00:00 2024-08-17T02:27:05.186 INFO:teuthology.orchestra.run.smithi110.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 371 kB/s | 19 kB 00:00 2024-08-17T02:27:05.203 INFO:teuthology.orchestra.run.smithi110.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-08-17T02:27:05.220 INFO:teuthology.orchestra.run.smithi110.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 271 kB/s | 9.0 kB 00:00 2024-08-17T02:27:05.237 INFO:teuthology.orchestra.run.smithi110.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 1.2 MB/s | 41 kB 00:00 2024-08-17T02:27:05.262 INFO:teuthology.orchestra.run.smithi110.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:27:05.279 INFO:teuthology.orchestra.run.smithi110.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 4.6 MB/s | 79 kB 00:00 2024-08-17T02:27:05.296 INFO:teuthology.orchestra.run.smithi110.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-08-17T02:27:05.338 INFO:teuthology.orchestra.run.smithi110.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-08-17T02:27:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-08-17T02:27:05.381 INFO:teuthology.orchestra.run.smithi110.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:27:05.414 INFO:teuthology.orchestra.run.smithi110.stdout:(110/133): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-08-17T02:27:05.431 INFO:teuthology.orchestra.run.smithi110.stdout:(111/133): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-08-17T02:27:05.448 INFO:teuthology.orchestra.run.smithi110.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-08-17T02:27:05.465 INFO:teuthology.orchestra.run.smithi110.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-08-17T02:27:05.490 INFO:teuthology.orchestra.run.smithi110.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-17T02:27:05.516 INFO:teuthology.orchestra.run.smithi110.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-17T02:27:05.541 INFO:teuthology.orchestra.run.smithi110.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:27:05.566 INFO:teuthology.orchestra.run.smithi110.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-17T02:27:05.608 INFO:teuthology.orchestra.run.smithi110.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 483 kB/s | 20 kB 00:00 2024-08-17T02:27:05.642 INFO:teuthology.orchestra.run.smithi110.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-08-17T02:27:05.701 INFO:teuthology.orchestra.run.smithi110.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:27:05.976 INFO:teuthology.orchestra.run.smithi110.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:27:06.076 INFO:teuthology.orchestra.run.smithi110.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 7.1 MB/s | 3.1 MB 00:00 2024-08-17T02:27:06.135 INFO:teuthology.orchestra.run.smithi110.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 6.8 MB/s | 2.9 MB 00:00 2024-08-17T02:27:06.345 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-08-17T02:27:06.345 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-08-17T02:27:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 69 kB/s | 41 kB 00:00 2024-08-17T02:27:07.035 INFO:teuthology.orchestra.run.smithi110.stdout:(125/133): NetworkManager-1.48.2-2.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-08-17T02:27:07.086 INFO:teuthology.orchestra.run.smithi110.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-08-17T02:27:07.544 INFO:teuthology.orchestra.run.smithi110.stdout:(127/133): NetworkManager-tui-1.48.2-2.el9.x86_ 303 kB/s | 247 kB 00:00 2024-08-17T02:27:07.611 INFO:teuthology.orchestra.run.smithi110.stdout:(128/133): elfutils-debuginfod-client-0.191-4.e 64 kB/s | 37 kB 00:00 2024-08-17T02:27:07.837 INFO:teuthology.orchestra.run.smithi110.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 276 kB/s | 207 kB 00:00 2024-08-17T02:27:08.320 INFO:teuthology.orchestra.run.smithi110.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 335 kB/s | 260 kB 00:00 2024-08-17T02:27:08.604 INFO:teuthology.orchestra.run.smithi110.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-08-17T02:27:08.920 INFO:teuthology.orchestra.run.smithi110.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-08-17T02:27:09.245 INFO:teuthology.orchestra.run.smithi110.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.2 MB/s | 1.1 MB 00:00 2024-08-17T02:27:09.251 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:27:09.251 INFO:teuthology.orchestra.run.smithi110.stdout:Total 14 MB/s | 206 MB 00:14 2024-08-17T02:27:10.905 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-08-17T02:27:11.113 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-08-17T02:27:11.113 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-08-17T02:27:11.935 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-08-17T02:27:12.032 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:27:12.082 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:27:12.148 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:27:12.200 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:27:12.232 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:27:12.287 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:27:12.610 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:27:12.708 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:27:12.845 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:27:12.884 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:27:13.010 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:27:13.171 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-08-17T02:27:13.172 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-08-17T02:27:13.483 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:27:13.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:27:13.646 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:27:13.727 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:27:13.754 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:27:13.866 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:27:13.897 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:27:14.040 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:27:14.321 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:27:14.503 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:27:14.581 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:27:14.699 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:14.781 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:15.126 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:15.166 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:27:15.207 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:27:15.288 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:27:15.356 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:27:15.390 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:27:15.477 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:27:15.549 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:27:15.585 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:27:15.632 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:27:15.710 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:27:15.748 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:27:15.794 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:27:15.886 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:27:16.056 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:27:16.124 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:27:16.773 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:27:16.865 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:27:16.906 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:27:16.952 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:27:16.996 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:27:17.034 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:27:17.089 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:27:17.128 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:27:17.187 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:27:17.271 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:27:17.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:27:17.465 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:27:17.523 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:27:17.576 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:27:17.626 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:27:17.786 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:27:17.842 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:27:17.885 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:27:17.999 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:27:18.035 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:27:18.078 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:27:18.108 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:27:18.144 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:27:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:27:18.211 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:27:18.246 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:27:18.280 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:27:18.322 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:27:18.355 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:27:18.390 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:27:18.440 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:27:18.587 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:27:18.645 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:27:18.995 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-08-17T02:27:19.127 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:27:19.184 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:27:19.250 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:27:19.306 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:27:19.335 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:27:19.387 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:27:19.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:27:19.564 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:27:19.597 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:27:19.709 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:27:19.745 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:27:19.756 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:27:19.869 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:27:19.978 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:27:20.005 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:27:20.011 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:27:20.059 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:27:20.105 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:27:20.178 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:27:20.659 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:27:20.696 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:27:20.787 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:27:20.864 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:27:20.889 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:27:20.894 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:27:21.003 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:27:21.040 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:27:21.049 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:27:21.186 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:27:21.456 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:27:21.663 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:27:21.733 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:27:21.834 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:21.933 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:22.272 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:27:22.314 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:27:22.367 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:27:22.450 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:27:22.500 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:27:22.534 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:27:22.594 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:27:22.622 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:27:22.686 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:27:22.698 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:27:22.720 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:27:22.734 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:27:22.767 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:27:22.768 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:27:22.848 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:27:22.883 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:27:22.930 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:27:23.021 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:27:23.079 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:27:23.120 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:27:23.190 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:27:23.236 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:27:23.250 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:27:23.264 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:27:23.888 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:27:23.982 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:27:24.030 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:27:24.079 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:27:24.122 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:27:24.160 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:27:24.204 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:27:24.244 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:27:24.439 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:27:24.623 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:27:24.670 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:27:24.707 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:27:24.764 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:27:24.809 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:27:24.884 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:27:25.053 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:27:25.100 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:27:25.143 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:27:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:27:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:27:25.345 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:27:25.383 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:27:25.420 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:27:25.458 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:27:25.495 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:27:25.530 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:27:25.563 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:27:25.606 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:27:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:27:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:27:25.724 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:27:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:27:25.869 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:25.918 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:27:26.508 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:26.555 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:27:26.690 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:27:26.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:27:26.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:27:26.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:26.731 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:27:27.133 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:27:27.190 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:27:27.224 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:27:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:27:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:27:27.603 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:27:27.629 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:27:27.723 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:27:28.527 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:27:28.666 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:27:30.270 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:27:30.367 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:27:30.403 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:27:30.436 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:27:30.762 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:27:30.798 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:27:30.898 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:27:30.924 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:27:33.570 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:33.613 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:27:34.258 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:27:34.370 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:27:34.370 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:27:34.370 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:27:34.370 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-08-17T02:27:38.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:38.862 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:27:38.900 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:27:38.900 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:38.900 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:27:38.900 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:40.356 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:27:40.413 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:27:40.413 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:40.414 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:27:40.414 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:27:40.414 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:27:40.414 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:40.640 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:27:40.690 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:27:40.690 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:40.690 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:27:40.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:27:40.690 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:27:40.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:41.099 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:27:41.150 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:41.274 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:27:41.334 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:27:41.398 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:27:41.621 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:27:41.677 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:27:41.762 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:27:41.863 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:27:42.019 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:27:42.065 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:27:42.092 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:27:42.127 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:27:42.176 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:27:42.202 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:27:42.737 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:27:42.767 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:27:42.797 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:27:42.850 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:27:42.890 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:27:44.030 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:27:44.075 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:27:45.151 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:27:45.184 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:27:45.319 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:27:45.487 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:27:45.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:27:45.570 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:27:45.571 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:45.571 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:27:45.571 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:27:45.571 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:27:45.571 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:45.620 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:27:45.645 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:27:45.746 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:27:45.801 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:27:46.316 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:27:46.316 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-08-17T02:27:46.316 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-08-17T02:27:46.317 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:46.533 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:27:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:27:46.570 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:46.570 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:27:46.570 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:47.139 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:27:47.180 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:27:47.294 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:47.340 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:27:47.389 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:27:47.390 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:47.390 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:27:47.390 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:47.458 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:27:47.508 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:47.825 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:27:47.875 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:27:47.876 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:47.876 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:27:47.876 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:27:47.876 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:27:47.876 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:27:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:27:48.111 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:48.345 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:27:48.395 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:27:48.395 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:48.395 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:27:48.395 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:27:48.395 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:27:48.396 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:48.813 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:27:48.864 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:48.996 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:27:49.055 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:27:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:27:49.347 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:27:49.409 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:27:49.495 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:27:49.604 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:27:49.766 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:27:49.830 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:27:49.856 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:27:49.892 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:27:49.941 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:27:49.966 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:27:50.453 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:27:50.483 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:27:50.512 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:27:50.574 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:27:50.605 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:27:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:27:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:27:52.554 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:27:52.595 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:27:52.638 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:27:52.668 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:27:52.702 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:27:52.737 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:27:52.776 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:27:52.807 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:27:52.864 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:27:52.898 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:27:52.924 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:27:53.061 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:27:53.223 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:27:53.259 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:27:53.311 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:53.360 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:27:53.386 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:27:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:27:53.558 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:27:54.148 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:27:54.397 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:27:54.476 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:27:54.522 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:27:54.629 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:27:54.670 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:27:54.695 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:27:54.721 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:27:54.749 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:27:54.749 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:27:54.849 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:27:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:27:54.881 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:27:54.935 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:27:54.980 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:27:54.991 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:27:55.024 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:27:55.047 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:27:55.048 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:27:55.076 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:55.131 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:27:55.181 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:55.248 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:27:55.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:55.301 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:27:55.301 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:27:55.412 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:27:55.444 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:27:55.475 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:27:55.559 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:27:55.633 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:27:55.684 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:27:55.779 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:27:55.780 INFO:teuthology.orchestra.run.smithi177.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:27:55.780 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:00.495 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:28:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:28:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:28:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:28:00.894 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:28:00.929 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:28:00.968 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:28:00.999 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:28:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:28:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:28:01.029 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:28:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:28:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:28:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:28:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:28:01.030 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:28:01.031 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:28:01.032 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:28:01.033 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:28:01.034 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:28:01.035 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:28:01.036 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:28:01.037 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:28:01.038 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:28:01.039 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:28:01.040 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:28:01.041 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:28:01.042 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:28:01.056 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:28:02.332 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:28:02.583 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:28:02.660 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:28:02.707 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:28:02.807 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:28:02.839 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:28:02.872 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:28:02.898 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:28:02.927 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:02.928 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.929 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.930 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:28:02.931 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:28:02.932 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:28:02.933 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:28:02.934 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:28:02.935 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:28:02.936 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:02.937 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:02.938 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-08-17T02:28:03.026 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:28:03.059 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:28:03.059 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:28:03.169 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:28:03.218 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:28:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:28:03.235 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:28:03.479 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:28:03.479 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:28:03.506 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:03.581 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:28:03.613 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:28:03.641 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:28:03.713 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:28:03.905 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:28:03.906 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:28:03.906 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:28:09.053 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:28:09.054 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:28:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:28:09.055 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:28:09.064 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:28:09.064 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:28:09.065 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:28:09.066 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:28:09.067 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:28:09.068 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:28:09.069 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:28:09.070 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:28:09.071 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:28:09.072 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:28:09.073 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:28:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:28:10.968 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:10.969 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.970 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.971 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.972 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:28:10.973 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.974 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:28:10.975 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:28:10.976 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:28:10.977 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:28:10.978 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:28:10.979 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:28:10.980 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:28:10.980 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:10.980 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-08-17T02:28:11.602 DEBUG:teuthology.parallel:result is None 2024-08-17T02:28:11.603 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:28:11.756 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:28:11.803 INFO:teuthology.orchestra.run.smithi110.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:28:11.804 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:28:11.804 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:28:11.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:28:11.949 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:28:12.000 INFO:teuthology.orchestra.run.smithi177.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:28:12.000 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:28:12.000 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:28:12.002 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:28:12.002 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:12.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:28:12.063 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:12.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:28:12.125 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:28:12.125 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:12.125 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:28:12.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:28:12.283 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:12.283 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:28:12.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:28:12.436 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:28:12.436 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:12.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:28:12.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:28:12.589 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:12.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:28:12.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:28:12.739 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:28:12.739 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:12.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:28:12.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:28:12.894 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:12.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:28:12.949 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:28:13.045 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:28:13.121 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:28:13.121 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-08-17T02:28:13.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-08-17T02:28:13.180 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:28:13.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:28:13.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:28:13.240 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:28:13.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:28:13.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:28:13.304 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:28:13.305 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:28:13.305 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:28:13.305 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:13.305 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:28:13.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.567 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:13.568 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:28:13.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.768 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:13.828 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:28:13.828 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:28:13.829 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858284', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpZqRMUpRkaPJY4TLpIHSZnRbOwtnPIXlBj/0kxTd5p+2nGMN1uO9qKEj/Q8f/LPkATR2E95kbExOBXg6IzxcQ=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOh56+4m3AtqHR+h4Mt/cq3eKCmiwtWudUgvZMPlYyJIBrWmHriKHd95AURsZn02TiJSMINWYx3hU9SUREBrLSA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:10:27', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:28:13.829 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:28:13.835 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:28:13.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:28:13.911 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:28:13.966 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:13.966 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:28:14.001 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:28:14.001 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-08-17 02:28:04.236483112 +0000 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-08-17 02:25:43.384344847 +0000 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-08-17 02:25:43.384344847 +0000 2024-08-17T02:28:14.076 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-08-17 02:25:43.384344847 +0000 2024-08-17T02:28:14.076 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:28:14.168 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-08-17T02:28:14.168 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-08-17T02:28:14.168 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000237122 s, 2.2 MB/s 2024-08-17T02:28:14.171 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:28:14.208 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-08-17 02:28:04.237483094 +0000 2024-08-17T02:28:14.283 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-08-17 02:25:43.849336944 +0000 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-08-17 02:25:43.849336944 +0000 2024-08-17T02:28:14.284 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-08-17 02:25:43.849336944 +0000 2024-08-17T02:28:14.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:28:14.375 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-08-17T02:28:14.375 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-08-17T02:28:14.375 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000185376 s, 2.8 MB/s 2024-08-17T02:28:14.377 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:28:14.413 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-08-17 02:28:04.237483094 +0000 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-08-17 02:25:44.322328905 +0000 2024-08-17T02:28:14.488 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-08-17 02:25:44.322328905 +0000 2024-08-17T02:28:14.489 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-08-17 02:25:44.322328905 +0000 2024-08-17T02:28:14.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:28:14.580 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-08-17T02:28:14.580 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-08-17T02:28:14.580 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000176573 s, 2.9 MB/s 2024-08-17T02:28:14.583 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:28:14.619 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-08-17T02:28:14.695 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:28:14.695 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:14.695 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-08-17 02:28:04.238483077 +0000 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-08-17 02:25:44.789320969 +0000 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-08-17 02:25:44.789320969 +0000 2024-08-17T02:28:14.696 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-08-17 02:25:44.789320969 +0000 2024-08-17T02:28:14.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:28:14.787 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-08-17T02:28:14.787 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-08-17T02:28:14.787 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000204503 s, 2.5 MB/s 2024-08-17T02:28:14.789 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:28:14.825 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:14.825 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:14.825 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:28:14.861 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:28:14.862 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-08-17T02:28:14.937 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:28:14.937 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:14.937 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-08-17T02:28:14.937 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:14.938 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:14.938 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-17 02:27:56.136467878 +0000 2024-08-17T02:28:14.938 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-17 02:25:43.643615309 +0000 2024-08-17T02:28:14.938 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-17 02:25:43.643615309 +0000 2024-08-17T02:28:14.938 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-17 02:25:43.643615309 +0000 2024-08-17T02:28:14.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-17T02:28:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000281679 s, 1.8 MB/s 2024-08-17T02:28:15.033 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:28:15.069 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 658 Links: 1 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-17 02:27:56.137467850 +0000 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-17 02:25:44.106602622 +0000 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-17 02:25:44.107602594 +0000 2024-08-17T02:28:15.144 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-17 02:25:44.106602622 +0000 2024-08-17T02:28:15.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:28:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-17T02:28:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-17T02:28:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000271429 s, 1.9 MB/s 2024-08-17T02:28:15.239 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:28:15.275 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-08-17T02:28:15.351 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:28:15.351 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 675 Links: 1 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-17 02:27:56.137467850 +0000 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-17 02:25:44.582589578 +0000 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-17 02:25:44.582589578 +0000 2024-08-17T02:28:15.352 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-17 02:25:44.582589578 +0000 2024-08-17T02:28:15.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:28:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-17T02:28:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-17T02:28:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000300314 s, 1.7 MB/s 2024-08-17T02:28:15.446 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:28:15.481 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 694 Links: 1 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-08-17 02:27:56.138467823 +0000 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-08-17 02:25:45.067576287 +0000 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-08-17 02:25:45.067576287 +0000 2024-08-17T02:28:15.556 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-08-17 02:25:45.067576287 +0000 2024-08-17T02:28:15.556 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:28:15.649 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-08-17T02:28:15.649 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-08-17T02:28:15.649 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000303411 s, 1.7 MB/s 2024-08-17T02:28:15.651 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:28:15.688 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:15.688 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:28:15.688 INFO:tasks.ceph:Generating config... 2024-08-17T02:28:15.689 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:28:15.689 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:28:15.689 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:28:15.690 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:28:15.690 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:28:15.690 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:28:15.690 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:28:15.690 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:28:15.691 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:28:15.691 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:28:15.691 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:28:15.691 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:28:15.691 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:28:15.692 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:28:15.692 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:28:15.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:28:15.778 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:28:15.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:28:15.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:28:15.916 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.110'), ('mon.b', '172.21.15.177'), ('mon.c', '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]')] 2024-08-17T02:28:15.917 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.110,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:28:15.919 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:15.919 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:28:15.954 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.110 --add b 172.21.15.177 --addv c '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: generated fsid 19a3b248-ccfd-4c4b-910e-9f89c1cc3c77 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:setting min_mon_release = octopus 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:epoch 0 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:fsid 19a3b248-ccfd-4c4b-910e-9f89c1cc3c77 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:last_changed 2024-08-17T02:28:16.063487+0000 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:created 2024-08-17T02:28:16.063487+0000 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:min_mon_release 15 (octopus) 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:election_strategy: 1 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:0: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.a 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-08-17T02:28:16.063 INFO:teuthology.orchestra.run.smithi110.stdout:2: [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] mon.c 2024-08-17T02:28:16.064 INFO:teuthology.orchestra.run.smithi110.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:28:16.065 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:28:16.100 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 19a3b248-ccfd-4c4b-910e-9f89c1cc3c77... 2024-08-17T02:28:16.102 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:28:16.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-08-17T02:28:16.237 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-08-17T02:28:16.238 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-08-17T02:28:16.239 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.110,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 19a3b248-ccfd-4c4b-910e-9f89c1cc3c77 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:28:16.240 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-08-17T02:28:16.241 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-08-17T02:28:16.242 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-08-17T02:28:16.243 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug finisher = 20 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-08-17T02:28:16.244 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.245 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2024-08-17T02:28:16.246 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-08-17T02:28:16.247 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:28:16.248 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-08-17T02:28:16.249 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-08-17T02:28:16.250 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.110,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-08-17T02:28:16.251 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 19a3b248-ccfd-4c4b-910e-9f89c1cc3c77 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.252 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.253 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-08-17T02:28:16.254 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-08-17T02:28:16.255 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug finisher = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-08-17T02:28:16.256 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.257 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:28:16.258 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-08-17T02:28:16.259 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-08-17T02:28:16.260 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-08-17T02:28:16.266 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:28:16.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:28:16.356 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:28:16.356 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:16.356 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:28:16.390 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:16.391 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:28:16.466 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:28:16.466 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:16.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:28:16.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:28:16.583 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:16.583 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:16.658 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:28:16.658 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:16.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:28:16.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:28:16.738 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:16.738 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:16.813 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:28:16.813 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:28:16.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:28:16.911 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:28:16.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:28:17.025 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:28:17.031 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:28:17.031 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:28:17.128 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:28:17.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:28:17.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:28:17.285 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:28:17.289 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:28:17.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:28:17.443 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:28:17.448 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:28:17.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:28:17.602 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:28:17.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:28:17.662 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:28:17.662 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:28:17.737 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:28:17.764 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:28:17.839 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:28:17.865 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:28:17.941 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:28:17.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:28:18.042 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:28:18.069 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:28:18.069 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:28:18.069 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:18.124 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:18.124 INFO:tasks.ceph:role: osd.0 2024-08-17T02:28:18.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:28:18.125 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:18.179 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:18.180 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:18.180 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:18.212 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-08-17T02:28:18.216 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-08-17T02:28:18.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:18.295 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:18.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:18.415 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:18.415 INFO:tasks.ceph:role: osd.1 2024-08-17T02:28:18.415 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:28:18.415 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:18.471 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:18.472 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:18.472 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:18.472 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:18.504 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-08-17T02:28:18.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-08-17T02:28:18.508 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:18.588 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:18.649 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:18.705 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:18.705 INFO:tasks.ceph:role: osd.2 2024-08-17T02:28:18.706 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:28:18.706 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:18.761 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:18.794 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-08-17T02:28:18.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-08-17T02:28:18.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:18.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:18.942 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:18.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:18.999 INFO:tasks.ceph:role: osd.3 2024-08-17T02:28:18.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:28:18.999 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:28:19.053 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:19.053 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:19.053 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:19.053 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:19.054 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:19.086 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-08-17T02:28:19.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-08-17T02:28:19.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:19.172 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:19.234 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:19.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.328+0000 7f3abca0a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:28:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.328+0000 7f3abca0a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:28:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.328+0000 7f3abca0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:28:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.328+0000 7f3abca0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:28:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.328+0000 7f3abca0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:28:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.331+0000 7f3abca0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:28:19.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:19.882+0000 7f3abca0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:20.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:20.649+0000 7f3abca0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:21.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:21.420+0000 7f3abca0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:22.248 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:28:22.304 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:22.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.387+0000 7f649c00b2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:28:22.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.387+0000 7f649c00b2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:28:22.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.388+0000 7f649c00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:28:22.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.388+0000 7f649c00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:28:22.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.388+0000 7f649c00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:28:22.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.389+0000 7f649c00b2c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:28:22.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:22.927+0000 7f649c00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:23.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:23.697+0000 7f649c00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:24.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:24.468+0000 7f649c00b2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:25.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:28:25.365 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:25.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.448+0000 7f3fa2a2d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:28:25.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.448+0000 7f3fa2a2d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:28:25.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.448+0000 7f3fa2a2d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:28:25.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.448+0000 7f3fa2a2d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:28:25.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.448+0000 7f3fa2a2d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:28:25.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.450+0000 7f3fa2a2d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:28:25.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:25.991+0000 7f3fa2a2d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:26.760+0000 7f3fa2a2d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:27.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:27.545+0000 7f3fa2a2d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:28.382 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:28:28.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:28.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.521+0000 7fba4a0392c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:28:28.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.521+0000 7fba4a0392c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:28:28.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.521+0000 7fba4a0392c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:28:28.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.521+0000 7fba4a0392c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:28:28.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.522+0000 7fba4a0392c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:28:28.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:28.523+0000 7fba4a0392c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:28:29.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:29.076+0000 7fba4a0392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:29.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:29.856+0000 7fba4a0392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:30.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:30.634+0000 7fba4a0392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:31.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:28:31.526 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:31.587 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:31.587 INFO:tasks.ceph:role: osd.4 2024-08-17T02:28:31.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:28:31.588 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:32.055 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-08-17T02:28:32.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-08-17T02:28:32.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:32.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:32.254 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:32.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:32.310 INFO:tasks.ceph:role: osd.5 2024-08-17T02:28:32.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:28:32.314 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:32.377 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:32.378 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:32.378 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:32.734 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-08-17T02:28:32.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-08-17T02:28:32.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:32.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:32.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:32.950 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:32.950 INFO:tasks.ceph:role: osd.6 2024-08-17T02:28:32.950 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:28:32.951 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:28:33.013 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:33.014 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:33.399 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-08-17T02:28:33.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-08-17T02:28:33.403 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:33.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:33.561 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:33.616 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:28:33.617 INFO:tasks.ceph:role: osd.7 2024-08-17T02:28:33.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:28:33.617 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:28:33.680 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:28:34.105 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-08-17T02:28:34.109 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-08-17T02:28:34.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:34.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:34.310 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:34.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.441+0000 7fe90fe192c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:28:34.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.442+0000 7fe90fe192c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:28:34.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.442+0000 7fe90fe192c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:28:34.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.442+0000 7fe90fe192c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:28:34.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.443+0000 7fe90fe192c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:28:34.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:34.451+0000 7fe90fe192c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:28:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:35.012+0000 7fe90fe192c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:35.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:35.790+0000 7fe90fe192c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:36.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:36.557+0000 7fe90fe192c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:37.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:28:37.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:37.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.524+0000 7f79d4c162c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:28:37.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.525+0000 7f79d4c162c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:28:37.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.525+0000 7f79d4c162c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:28:37.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.525+0000 7f79d4c162c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:28:37.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.525+0000 7f79d4c162c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:28:37.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:37.527+0000 7f79d4c162c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:28:38.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:38.082+0000 7f79d4c162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:38.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:38.847+0000 7f79d4c162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:39.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:39.619+0000 7f79d4c162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:40.448 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:28:40.506 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:40.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.589+0000 7f512a3202c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:28:40.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.589+0000 7f512a3202c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:28:40.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.589+0000 7f512a3202c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:28:40.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.589+0000 7f512a3202c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:28:40.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.589+0000 7f512a3202c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:28:40.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:40.591+0000 7f512a3202c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:28:41.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:41.135+0000 7f512a3202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:41.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:41.907+0000 7f512a3202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:42.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:42.685+0000 7f512a3202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:43.530 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:28:43.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:43.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.670+0000 7f235e2202c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:28:43.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.670+0000 7f235e2202c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:28:43.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.670+0000 7f235e2202c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:28:43.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.670+0000 7f235e2202c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:28:43.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.670+0000 7f235e2202c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:28:43.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:43.672+0000 7f235e2202c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:28:43.831 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:43.835 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:44.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:44.208+0000 7f235e2202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:44.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:44.978+0000 7f235e2202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:45.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:45.752+0000 7f235e2202c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:28:46.583 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:28:46.642 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:28:46.643 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:46.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:28:46.704 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:46.705 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:28:46.803 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:46.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:28:46.900 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:46.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:28:46.995 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:46.996 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:28:47.090 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:47.090 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:28:47.185 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:47.185 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:28:47.280 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:28:47.342 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.342 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:28:47.440 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:28:47.536 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.537 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:28:47.631 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:28:47.726 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.726 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:28:47.821 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:47.821 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:28:47.916 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:47.917 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:28:47.953 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:47.953 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:28:48.028 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:48.028 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:28:48.062 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:48.062 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:28:48.137 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:28:48.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:28:48.141 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:28:48.189 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-08-17T02:28:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDACsBmJuNYNhAAjtbVni54w1UnqJPYevyZIA== 2024-08-17T02:28:48.190 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-08-17T02:28:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmNHq1BxAAUU2f4oXpWtnV2z1C5cHBew== 2024-08-17T02:28:48.190 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-08-17T02:28:48.190 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmnecHERAAwyQas+64gOqZtYBmQ1WzjA== 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDDCsBmbCGcExAABby/jxq5sNgve+Wpj3twzQ== 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDGCsBmAq0lFxAAt1Fr40V7KeG2MoyBvW8ebg== 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDJCsBmbC3GGhAAP1RjM3jiyr6AADdPimUWNw== 2024-08-17T02:28:48.191 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDMCsBmoGUiHxAAKStyhVYSdY2y+8eIM4LcHw== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBm6veJARAApiHTGxPnuChTx4K7Ih4m8Q== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmpdV1GhAAAFqeamv2ceNs1jEgU5uq3A== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmZqvoIxAAeeIeIatn2IK91DPOCUtpRQ== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDSCsBmrS9mGhAAFRqsITV65onB0ZwMBOjT8Q== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDVCsBmgv1XHxAAQYaWu4PBiu+VQ9+yBMoBAQ== 2024-08-17T02:28:48.192 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDYCsBmbG4sIxAAqmrreGB5o5s2IuA6NGCofA== 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDbCsBmZAsAKBAAUm1P7Km50dDsmSiDCG1xMQ== 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmQ/P/KxAA6/YlYKBE0kEf982XrEdQGA== 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:[client.2] 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBm+GEOMhAAa2CSQP93CvdjKFBtrjwiCQ== 2024-08-17T02:28:48.193 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-08-17T02:28:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBCsBmK9gfOBAAknlE9UetXeSk9F1R6n1fmA== 2024-08-17T02:28:48.194 INFO:teuthology.orchestra.run.smithi110.stdout:[client.3] 2024-08-17T02:28:48.194 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDCCsBmJ/OXAhAAOhU5MOQzGt2biULdexICpw== 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDACsBmJuNYNhAAjtbVni54w1UnqJPYevyZIA== 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmNHq1BxAAUU2f4oXpWtnV2z1C5cHBew== 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmnecHERAAwyQas+64gOqZtYBmQ1WzjA== 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDDCsBmbCGcExAABby/jxq5sNgve+Wpj3twzQ== 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-08-17T02:28:48.229 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDGCsBmAq0lFxAAt1Fr40V7KeG2MoyBvW8ebg== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDJCsBmbC3GGhAAP1RjM3jiyr6AADdPimUWNw== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDMCsBmoGUiHxAAKStyhVYSdY2y+8eIM4LcHw== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBm6veJARAApiHTGxPnuChTx4K7Ih4m8Q== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmpdV1GhAAAFqeamv2ceNs1jEgU5uq3A== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmZqvoIxAAeeIeIatn2IK91DPOCUtpRQ== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDSCsBmrS9mGhAAFRqsITV65onB0ZwMBOjT8Q== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDVCsBmgv1XHxAAQYaWu4PBiu+VQ9+yBMoBAQ== 2024-08-17T02:28:48.230 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDYCsBmbG4sIxAAqmrreGB5o5s2IuA6NGCofA== 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDbCsBmZAsAKBAAUm1P7Km50dDsmSiDCG1xMQ== 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmQ/P/KxAA6/YlYKBE0kEf982XrEdQGA== 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBm+GEOMhAAa2CSQP93CvdjKFBtrjwiCQ== 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDBCsBmK9gfOBAAknlE9UetXeSk9F1R6n1fmA== 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2024-08-17T02:28:48.231 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQDCCsBmJ/OXAhAAOhU5MOQzGt2biULdexICpw== 2024-08-17T02:28:48.232 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:28:48.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:28:48.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:48.362 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:48.451 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:48.455 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:48.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.638 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.818 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:48.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:28:48.909 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:28:48.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:48.999 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:49.088 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:49.091 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:28:49.180 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.185 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.277 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:28:49.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:28:49.917 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:28:49.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:28:49.972 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:28:50.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:28:50.126 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:28:50.182 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:28:50.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:28:50.336 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:28:50.391 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:28:50.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:28:50.545 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:50.549 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:28:50.583 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:28:50.584 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:28:50.584 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:28:50.624 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:28:50.624 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:28:50.624 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:28:50.628 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:28:50.628 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:28:50.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:28:50.631 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:28:50.632 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:28:50.632 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:28:50.632 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:28:50.635 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:28:50.636 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:28:50.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:28:50.639 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:28:50.639 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:28:50.640 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:28:50.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.787+0000 7fec61400640 1 Processor -- start 2024-08-17T02:28:50.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.787+0000 7fec61400640 1 -- start start 2024-08-17T02:28:50.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.787+0000 7fec61400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:50.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.787+0000 7fec61400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0cac70 con 0x7fec5c0ca830 2024-08-17T02:28:50.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.787+0000 7fec61400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c0ce9c0 con 0x7fec5c158bd0 2024-08-17T02:28:50.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec61400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0cf600 con 0x7fec5c158fa0 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49336/0 (socket says 172.21.15.110:49336) 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 learned_addr learned my addr 172.21.15.110:0/4095920056 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 msgr2=0x7fec5c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 msgr2=0x7fec5c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:28:50.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.788+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:28:50.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.989+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:50.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.989+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 msgr2=0x7fec5c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-17T02:28:50.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.989+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 msgr2=0x7fec5c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:28:50.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.989+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:28:50.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.989+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:28:50.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833334473 0 0) 0x7fec5c0cac70 con 0x7fec5c0ca830 2024-08-17T02:28:50.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec400034e0 con 0x7fec5c0ca830 2024-08-17T02:28:50.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269828412 0 0) 0x7fec400034e0 con 0x7fec5c0ca830 2024-08-17T02:28:50.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 msgr2=0x7fec5c0ca2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 --2- 172.21.15.110:0/4095920056 >> v2:172.21.15.110:3300/0 conn(0x7fec5c158fa0 0x7fec5c0ca2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 >> v1:172.21.15.177:6789/0 conn(0x7fec5c158bd0 legacy=0x7fec5c0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0cec60 con 0x7fec5c0ca830 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fec54001470 con 0x7fec5c0ca830 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 >> v1:172.21.15.110:6789/0 conn(0x7fec5c0ca830 legacy=0x7fec5c0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec400039d0 0x7fec40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 0x7fec40004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec40005250 0x7fec4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0cf600 con 0x7fec40004780 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4000c1a0 con 0x7fec400039d0 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4000c360 con 0x7fec40005250 2024-08-17T02:28:51.000 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 0x7fec40004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.997+0000 7fec5b200640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec40005250 0x7fec4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec5a800640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec400039d0 0x7fec40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec40005250 msgr2=0x7fec4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec40005250 0x7fec4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec400039d0 msgr2=0x7fec40003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec400039d0 0x7fec40003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec59e00640 1 -- 172.21.15.110:0/4095920056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec400034e0 con 0x7fec40004780 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec5a800640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec400039d0 0x7fec40003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.998+0000 7fec5b200640 1 -- 172.21.15.110:0/4095920056 reap_dead start 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.999+0000 7fec59e00640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 0x7fec40004bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fec48006f60 tx=0x7fec48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571734c00cb4df6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.999+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48033410 con 0x7fec40004780 2024-08-17T02:28:51.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.999+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4802d030 con 0x7fec40004780 2024-08-17T02:28:51.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:50.999+0000 7fec59400640 1 -- 172.21.15.110:0/4095920056 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec480337c0 con 0x7fec40004780 2024-08-17T02:28:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 -- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 msgr2=0x7fec40004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 0x7fec40004bf0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fec48006f60 tx=0x7fec48008040 comp rx=0 tx=0).stop 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 -- 172.21.15.110:0/4095920056 shutdown_connections 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 --2- 172.21.15.110:0/4095920056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec40004780 0x7fec40004bf0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 -- 172.21.15.110:0/4095920056 >> 172.21.15.110:0/4095920056 conn(0x7fec5c06eb90 msgr2=0x7fec5c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 -- 172.21.15.110:0/4095920056 shutdown_connections 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.000+0000 7fec61400640 1 -- 172.21.15.110:0/4095920056 wait complete. 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.001+0000 7fec61400640 1 Processor -- start 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 -- start start 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec40004780 0x7fec5c157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c0c44a0 0x7fec5c15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15e1e0 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c0b16d0 con 0x7fec40004780 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.002+0000 7fec61400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c15d5d0 con 0x7fec5c0c44a0 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49368/0 (socket says 172.21.15.110:49368) 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 -- 172.21.15.110:0/2505784405 learned_addr learned my addr 172.21.15.110:0/2505784405 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5a800640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec40004780 0x7fec5c157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec59e00640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c0c44a0 0x7fec5c15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 -- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c0c44a0 msgr2=0x7fec5c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c0c44a0 0x7fec5c15cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 -- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec40004780 msgr2=0x7fec5c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec40004780 0x7fec5c157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 -- 172.21.15.110:0/2505784405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c15d8b0 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.006 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.003+0000 7fec5b200640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec54009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5400ee60 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54013420 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec540137e0 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c15db90 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fec5401d460 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c158330 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.004+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec54013de0 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.007 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.005+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c15e010 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.008+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fec54027490 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.078+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fec5c071050 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.081+0000 7fec52000640 1 -- 172.21.15.110:0/2505784405 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fec54027720 con 0x7fec5c0b0cf0 2024-08-17T02:28:51.081 INFO:teuthology.orchestra.run.smithi110.stderr:adjusted tunables profile to default 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 msgr2=0x7fec5c0b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec54000c00 tx=0x7fec54009040 comp rx=0 tx=0).stop 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 shutdown_connections 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec5c0b0cf0 0x7fec5c0b1190 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec5c0c44a0 0x7fec5c15cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 --2- 172.21.15.110:0/2505784405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec40004780 0x7fec5c157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 >> 172.21.15.110:0/2505784405 conn(0x7fec5c06eb90 msgr2=0x7fec5c068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 shutdown_connections 2024-08-17T02:28:51.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:51.082+0000 7fec61400640 1 -- 172.21.15.110:0/2505784405 wait complete. 2024-08-17T02:28:51.097 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:28:51.097 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:51.097 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:28:51.130 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:51.129+0000 7f1c46656ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:28:51.135 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:51.135+0000 7f070b413ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:28:51.153 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:51.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:28:51.249 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:51.249 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:28:51.294 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:51.292+0000 7f070b413ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:28:51.296 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:51.295+0000 7f1c46656ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:28:51.346 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-08-17T02:28:51.346 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:28:51.354 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:51.354+0000 7f070b413ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:28:51.355 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:51.354+0000 7f1c46656ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:28:51.410 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:51.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:28:51.467 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:51.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:28:51.563 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:51.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:28:51.641 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:51.641+0000 7f070b413ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:28:51.651 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:51.649+0000 7f1c46656ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:28:51.661 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-08-17T02:28:51.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:28:51.691 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:51.691+0000 7f070b413ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:28:51.705 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:51.702+0000 7f1c46656ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:28:51.757 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 41f73586-2f27-495d-9350-83143c2dfcaa 0 2024-08-17T02:28:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.941+0000 7fdccee00640 1 Processor -- start 2024-08-17T02:28:51.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.941+0000 7fdccee00640 1 -- start start 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.942+0000 7fdccee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.942+0000 7fdccee00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80cadc0 con 0x7fdcc80ccca0 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.942+0000 7fdccee00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80cb060 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.942+0000 7fdccee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80cb880 con 0x7fdcc8159b90 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccd000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdcc80ca8a0 0x7fdcc80cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47834/0 (socket says 172.21.15.177:47834) 2024-08-17T02:28:51.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccd000640 1 -- 172.21.15.177:0/3395240806 learned_addr learned my addr 172.21.15.177:0/3395240806 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-08-17T02:28:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccda00640 1 --2- 172.21.15.177:0/3395240806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccda00640 1 -- 172.21.15.177:0/3395240806 >> v1:172.21.15.177:6789/0 conn(0x7fdcc80ca8a0 legacy=0x7fdcc80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccda00640 1 -- 172.21.15.177:0/3395240806 >> v1:172.21.15.110:6789/0 conn(0x7fdcc80ccca0 legacy=0x7fdcc8162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.943+0000 7fdccda00640 1 -- 172.21.15.177:0/3395240806 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80cb300 con 0x7fdcc8159b90 2024-08-17T02:28:51.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.944+0000 7fdccda00640 1 --2- 172.21.15.177:0/3395240806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc80ca360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009880 tx=0x7fdcbc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47fb0a0a44e89f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.944+0000 7fdcc7e00640 1 -- 172.21.15.177:0/3395240806 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc02ad90 con 0x7fdcc8159b90 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.944+0000 7fdcc7e00640 1 -- 172.21.15.177:0/3395240806 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc032440 con 0x7fdcc8159b90 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.944+0000 7fdcc7e00640 1 -- 172.21.15.177:0/3395240806 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc032820 con 0x7fdcc8159b90 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 -- 172.21.15.177:0/3395240806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 msgr2=0x7fdcc80ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 --2- 172.21.15.177:0/3395240806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc80ca360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc009880 tx=0x7fdcbc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 -- 172.21.15.177:0/3395240806 shutdown_connections 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 --2- 172.21.15.177:0/3395240806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc80ca360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 -- 172.21.15.177:0/3395240806 >> 172.21.15.177:0/3395240806 conn(0x7fdcc8098e00 msgr2=0x7fdcc806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 -- 172.21.15.177:0/3395240806 shutdown_connections 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.945+0000 7fdccee00640 1 -- 172.21.15.177:0/3395240806 wait complete. 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.946+0000 7fdccee00640 1 Processor -- start 2024-08-17T02:28:51.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.947+0000 7fdccee00640 1 -- start start 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.947+0000 7fdccee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.947+0000 7fdccee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcc80ccca0 0x7fdcc809c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.947+0000 7fdccee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc816c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c45e0 con 0x7fdcc80ccca0 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c4ba0 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc809c6a0 con 0x7fdcc8159b90 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59752/0 (socket says 172.21.15.177:59752) 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 -- 172.21.15.177:0/3990275990 learned_addr learned my addr 172.21.15.177:0/3990275990 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:51.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccd000640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcc80ccca0 0x7fdcc809c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdcce400640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc816c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 -- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 msgr2=0x7fdcc816c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc816c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 -- 172.21.15.177:0/3990275990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcc80ccca0 msgr2=0x7fdcc809c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcc80ccca0 0x7fdcc809c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.948+0000 7fdccda00640 1 -- 172.21.15.177:0/3990275990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009390 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdccda00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0097d0 tx=0x7fdcbc032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc031a60 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc031bc0 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc046430 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc809c980 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc8169da0 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdcbc039040 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.949+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdcbc041030 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.950+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc8071050 con 0x7fdcc80ca8a0 2024-08-17T02:28:51.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:51.953+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdcbc04b060 con 0x7fdcc80ca8a0 2024-08-17T02:28:52.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.028+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "41f73586-2f27-495d-9350-83143c2dfcaa", "id": 0} v 0) v1 -- 0x7fdcc806ef00 con 0x7fdcc80ca8a0 2024-08-17T02:28:52.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.032+0000 7fdcc4c00640 1 -- 172.21.15.177:0/3990275990 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "41f73586-2f27-495d-9350-83143c2dfcaa", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcbc037070 con 0x7fdcc80ca8a0 2024-08-17T02:28:52.034 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-08-17T02:28:52.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.033+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 msgr2=0x7fdcc809bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.033+0000 7fdccee00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0097d0 tx=0x7fdcbc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 shutdown_connections 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcc8159b90 0x7fdcc816c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdcc80ccca0 0x7fdcc809c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 --2- 172.21.15.177:0/3990275990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcc80ca8a0 0x7fdcc809bb20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 >> 172.21.15.177:0/3990275990 conn(0x7fdcc8098e00 msgr2=0x7fdcc8158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 shutdown_connections 2024-08-17T02:28:52.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.034+0000 7fdccee00640 1 -- 172.21.15.177:0/3990275990 wait complete. 2024-08-17T02:28:52.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 457e617e-cd62-4a54-a4d4-b8a959f9275d 1 2024-08-17T02:28:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.195+0000 7f1bbae00640 1 Processor -- start 2024-08-17T02:28:52.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.195+0000 7f1bbae00640 1 -- start start 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bb4159f60 0x7f1bb40ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40cb880 con 0x7f1bb4159f60 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb40cd6e0 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bbae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40cadc0 con 0x7f1bb4159b90 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36578/0 (socket says 172.21.15.177:36578) 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59768/0 (socket says 172.21.15.177:59768) 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 -- 172.21.15.177:0/2464140125 learned_addr learned my addr 172.21.15.177:0/2464140125 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bba400640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.110:3300/0 conn(0x7f1bb4159f60 0x7f1bb40ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 -- 172.21.15.177:0/2464140125 >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 msgr2=0x7f1bb40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 -- 172.21.15.177:0/2464140125 >> v2:172.21.15.110:3300/0 conn(0x7f1bb4159f60 msgr2=0x7f1bb40ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.110:3300/0 conn(0x7f1bb4159f60 0x7f1bb40ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9a00640 1 -- 172.21.15.177:0/2464140125 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40cb060 con 0x7f1bb4159b90 2024-08-17T02:28:52.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.196+0000 7f1bb9000640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.197+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/2464140125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb406f360 tx=0x7f1ba80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3276190304f07aed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bb3e00640 1 -- 172.21.15.177:0/2464140125 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba802add0 con 0x7f1bb4159b90 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bb3e00640 1 -- 172.21.15.177:0/2464140125 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8032440 con 0x7f1bb4159b90 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bb3e00640 1 -- 172.21.15.177:0/2464140125 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8032820 con 0x7f1bb4159b90 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 -- 172.21.15.177:0/2464140125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 msgr2=0x7f1bb40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 --2- 172.21.15.177:0/2464140125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1bb406f360 tx=0x7f1ba80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 -- 172.21.15.177:0/2464140125 shutdown_connections 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.110:3300/0 conn(0x7f1bb4159f60 0x7f1bb40ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 --2- 172.21.15.177:0/2464140125 >> v2:172.21.15.177:3300/0 conn(0x7f1bb40ca8a0 0x7f1bb40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 --2- 172.21.15.177:0/2464140125 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb4159b90 0x7f1bb40ca360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 -- 172.21.15.177:0/2464140125 >> 172.21.15.177:0/2464140125 conn(0x7f1bb4098e00 msgr2=0x7f1bb406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 -- 172.21.15.177:0/2464140125 shutdown_connections 2024-08-17T02:28:52.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.198+0000 7f1bbae00640 1 -- 172.21.15.177:0/2464140125 wait complete. 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.200+0000 7f1bbae00640 1 Processor -- start 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.200+0000 7f1bbae00640 1 -- start start 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 0x7f1bb40c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb4159f60 0x7f1bb40682a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b44c0 con 0x7f1bb4159f60 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40c9b50 con 0x7f1bb4159b90 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bbae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b3b90 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36588/0 (socket says 172.21.15.177:36588) 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9a00640 1 -- 172.21.15.177:0/3758643182 learned_addr learned my addr 172.21.15.177:0/3758643182 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9000640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 0x7f1bb40c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bba400640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb4159f60 0x7f1bb40682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9a00640 1 -- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 msgr2=0x7f1bb40c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.201+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 0x7f1bb40c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb9a00640 1 -- 172.21.15.177:0/3758643182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb4159f60 msgr2=0x7f1bb40682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb4159f60 0x7f1bb40682a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb9a00640 1 -- 172.21.15.177:0/3758643182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009390 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb9000640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 0x7f1bb40c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb9a00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009210 tx=0x7f1ba8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8031c80 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8031e00 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba803d670 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba8009450 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb40b4150 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1ba8039040 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.202+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f1ba80464e0 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.203+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb4071050 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.206+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1ba8042070 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.278+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "457e617e-cd62-4a54-a4d4-b8a959f9275d", "id": 1} v 0) v1 -- 0x7f1bb415c3b0 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.282+0000 7f1bb0c00640 1 -- 172.21.15.177:0/3758643182 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "457e617e-cd62-4a54-a4d4-b8a959f9275d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ba8037070 con 0x7f1bb40ca8a0 2024-08-17T02:28:52.284 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 msgr2=0x7f1bb414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009210 tx=0x7f1ba8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 shutdown_connections 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb4159f60 0x7f1bb40682a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb4159b90 0x7f1bb40c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 --2- 172.21.15.177:0/3758643182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb40ca8a0 0x7f1bb414ff00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 >> 172.21.15.177:0/3758643182 conn(0x7f1bb4098e00 msgr2=0x7f1bb4157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 shutdown_connections 2024-08-17T02:28:52.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.283+0000 7f1bbae00640 1 -- 172.21.15.177:0/3758643182 wait complete. 2024-08-17T02:28:52.302 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new a31eae37-376e-4042-ade9-befabd23d1af 2 2024-08-17T02:28:52.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.447+0000 7f6fce000640 1 Processor -- start 2024-08-17T02:28:52.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.447+0000 7f6fce000640 1 -- start start 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.448+0000 7f6fce000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fc8159aa0 0x7f6fc80ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.448+0000 7f6fce000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6fc80ccf00 0x7f6fc81629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.448+0000 7f6fce000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80cad60 con 0x7f6fc8159e70 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.448+0000 7f6fce000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80c4b90 con 0x7f6fc80ccf00 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.448+0000 7f6fce000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80ce630 con 0x7f6fc8159aa0 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fc8159aa0 0x7f6fc80ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fc8159aa0 0x7f6fc80ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59788/0 (socket says 172.21.15.177:59788) 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 -- 172.21.15.177:0/3903350287 learned_addr learned my addr 172.21.15.177:0/3903350287 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fcd600640 1 --2- 172.21.15.177:0/3903350287 >> v2:172.21.15.110:3300/0 conn(0x7f6fc80ccf00 0x7f6fc81629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 -- 172.21.15.177:0/3903350287 >> v2:172.21.15.110:3300/0 conn(0x7f6fc80ccf00 msgr2=0x7f6fc81629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:52.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 --2- 172.21.15.177:0/3903350287 >> v2:172.21.15.110:3300/0 conn(0x7f6fc80ccf00 0x7f6fc81629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 -- 172.21.15.177:0/3903350287 >> v1:172.21.15.110:6789/0 conn(0x7f6fc8159e70 legacy=0x7f6fc80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.449+0000 7f6fccc00640 1 -- 172.21.15.177:0/3903350287 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80ce910 con 0x7f6fc8159aa0 2024-08-17T02:28:52.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.450+0000 7f6fccc00640 1 --2- 172.21.15.177:0/3903350287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159aa0 0x7f6fc80ce050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8089200 tx=0x7f6fbc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a1c3191198eb90 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.450+0000 7f6fc7400640 1 -- 172.21.15.177:0/3903350287 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc02ae80 con 0x7f6fc8159aa0 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.450+0000 7f6fc7400640 1 -- 172.21.15.177:0/3903350287 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc032440 con 0x7f6fc8159aa0 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.450+0000 7f6fc7400640 1 -- 172.21.15.177:0/3903350287 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc032800 con 0x7f6fc8159aa0 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 -- 172.21.15.177:0/3903350287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159aa0 msgr2=0x7f6fc80ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 --2- 172.21.15.177:0/3903350287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159aa0 0x7f6fc80ce050 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8089200 tx=0x7f6fbc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 -- 172.21.15.177:0/3903350287 shutdown_connections 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 --2- 172.21.15.177:0/3903350287 >> v2:172.21.15.110:3300/0 conn(0x7f6fc80ccf00 0x7f6fc81629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 --2- 172.21.15.177:0/3903350287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159aa0 0x7f6fc80ce050 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 -- 172.21.15.177:0/3903350287 >> 172.21.15.177:0/3903350287 conn(0x7f6fc8099040 msgr2=0x7f6fc806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 -- 172.21.15.177:0/3903350287 shutdown_connections 2024-08-17T02:28:52.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.451+0000 7f6fce000640 1 -- 172.21.15.177:0/3903350287 wait complete. 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.452+0000 7f6fce000640 1 Processor -- start 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.452+0000 7f6fce000640 1 -- start start 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fc8159aa0 0x7f6fc80cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 0x7f6fc80cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80b3fb0 con 0x7f6fc80ccf00 2024-08-17T02:28:52.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c7f40 con 0x7f6fc8159e70 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.453+0000 7f6fce000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80c7c60 con 0x7f6fc8159aa0 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fcd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 0x7f6fc80cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.177:46922/0 (socket says 172.21.15.177:46922) 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 -- 172.21.15.177:0/4111637873 learned_addr learned my addr 172.21.15.177:0/4111637873 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fc7e00640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fc8159aa0 0x7f6fc80cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 -- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fc8159aa0 msgr2=0x7f6fc80cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fc8159aa0 0x7f6fc80cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 -- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 msgr2=0x7f6fc80cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 0x7f6fc80cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 -- 172.21.15.177:0/4111637873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc009450 con 0x7f6fc80ccf00 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fcd600640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 0x7f6fc80cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.454+0000 7f6fccc00640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009940 tx=0x7f6fbc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc031c80 con 0x7f6fc80ccf00 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc031e00 con 0x7f6fc80ccf00 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc80b3960 con 0x7f6fc80ccf00 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc03d670 con 0x7f6fc80ccf00 2024-08-17T02:28:52.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc8155b50 con 0x7f6fc80ccf00 2024-08-17T02:28:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6fbc039040 con 0x7f6fc80ccf00 2024-08-17T02:28:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.455+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6fbc03daa0 con 0x7f6fc80ccf00 2024-08-17T02:28:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.456+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc80b37c0 con 0x7f6fc80ccf00 2024-08-17T02:28:52.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.458+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6fc80b37c0 con 0x7f6fc80ccf00 2024-08-17T02:28:52.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.533+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a31eae37-376e-4042-ade9-befabd23d1af", "id": 2} v 0) v1 -- 0x7f6fc8071050 con 0x7f6fc80ccf00 2024-08-17T02:28:52.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.536+0000 7f6fbbe00640 1 -- 172.21.15.177:0/4111637873 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a31eae37-376e-4042-ade9-befabd23d1af", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6fbc042070 con 0x7f6fc80ccf00 2024-08-17T02:28:52.538 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-08-17T02:28:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.537+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 msgr2=0x7f6fc8155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.537+0000 7f6fce000640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009940 tx=0x7f6fbc032000 comp rx=0 tx=0).stop 2024-08-17T02:28:52.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.537+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 shutdown_connections 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.537+0000 7f6fce000640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fc8159e70 0x7f6fc80cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.538+0000 7f6fce000640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fc8159aa0 0x7f6fc80cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.538+0000 7f6fce000640 1 --2- 172.21.15.177:0/4111637873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ccf00 0x7f6fc8155610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.538+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 >> 172.21.15.177:0/4111637873 conn(0x7f6fc8099040 msgr2=0x7f6fc8156560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.538+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 shutdown_connections 2024-08-17T02:28:52.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.538+0000 7f6fce000640 1 -- 172.21.15.177:0/4111637873 wait complete. 2024-08-17T02:28:52.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 75ab4ea1-8a49-47a1-82c8-f2d4cf642a40 3 2024-08-17T02:28:52.567 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:52.567+0000 7f070b413ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:28:52.579 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:52.578+0000 7f1c46656ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:28:52.663 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:52.663+0000 7f070b413ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:28:52.682 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:52.681+0000 7f1c46656ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:28:52.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.695+0000 7f763fe00640 1 Processor -- start 2024-08-17T02:28:52.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.695+0000 7f763fe00640 1 -- start start 2024-08-17T02:28:52.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763fe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400cad60 con 0x7f764015a2c0 2024-08-17T02:28:52.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763fe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400c4b90 con 0x7f7640159e70 2024-08-17T02:28:52.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400ce630 con 0x7f7640159aa0 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763e000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36608/0 (socket says 172.21.15.177:36608) 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763e000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59810/0 (socket says 172.21.15.177:59810) 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.696+0000 7f763ea00640 1 -- 172.21.15.177:0/2181750430 learned_addr learned my addr 172.21.15.177:0/2181750430 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763ea00640 1 -- 172.21.15.177:0/2181750430 >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 msgr2=0x7f76400cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:52.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763ea00640 1 --2- 172.21.15.177:0/2181750430 >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763ea00640 1 -- 172.21.15.177:0/2181750430 >> v1:172.21.15.177:6789/0 conn(0x7f764015a2c0 legacy=0x7f76400cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763d600640 1 -- 172.21.15.177:0/2181750430 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301650058 0 0) 0x7f76400cad60 con 0x7f764015a2c0 2024-08-17T02:28:52.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763ea00640 1 -- 172.21.15.177:0/2181750430 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400ce910 con 0x7f7640159aa0 2024-08-17T02:28:52.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.697+0000 7f763e000640 1 --2- 172.21.15.177:0/2181750430 >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.698+0000 7f763ea00640 1 --2- 172.21.15.177:0/2181750430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7630009910 tx=0x7f76300091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b30408e0cfb878db server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.698+0000 7f763d600640 1 -- 172.21.15.177:0/2181750430 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763002ae40 con 0x7f7640159aa0 2024-08-17T02:28:52.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.698+0000 7f763d600640 1 -- 172.21.15.177:0/2181750430 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630032440 con 0x7f7640159aa0 2024-08-17T02:28:52.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.698+0000 7f763d600640 1 -- 172.21.15.177:0/2181750430 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300327e0 con 0x7f7640159aa0 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 -- 172.21.15.177:0/2181750430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 msgr2=0x7f76400ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 --2- 172.21.15.177:0/2181750430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7630009910 tx=0x7f76300091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 -- 172.21.15.177:0/2181750430 shutdown_connections 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 --2- 172.21.15.177:0/2181750430 >> v2:172.21.15.177:3300/0 conn(0x7f7640159e70 0x7f76400cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 --2- 172.21.15.177:0/2181750430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7640159aa0 0x7f76400ce050 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 -- 172.21.15.177:0/2181750430 >> 172.21.15.177:0/2181750430 conn(0x7f7640099040 msgr2=0x7f764006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 -- 172.21.15.177:0/2181750430 shutdown_connections 2024-08-17T02:28:52.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.699+0000 7f763fe00640 1 -- 172.21.15.177:0/2181750430 wait complete. 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.700+0000 7f763fe00640 1 Processor -- start 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.700+0000 7f763fe00640 1 -- start start 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7640159aa0 0x7f7640151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 0x7f76400c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7640151da0 con 0x7f7640159aa0 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400c78f0 con 0x7f7640159e70 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400c7bd0 con 0x7f764015a2c0 2024-08-17T02:28:52.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.701+0000 7f763e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 0x7f76400c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59814/0 (socket says 172.21.15.177:59814) 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 -- 172.21.15.177:0/2309984502 learned_addr learned my addr 172.21.15.177:0/2309984502 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763ea00640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7640159aa0 0x7f7640151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 -- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 msgr2=0x7f76400c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 0x7f76400c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 -- 172.21.15.177:0/2309984502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7640159aa0 msgr2=0x7f7640151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7640159aa0 0x7f7640151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 -- 172.21.15.177:0/2309984502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c009390 con 0x7f7640159e70 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763f400640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 0x7f76400c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f763e000640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f762c00ec80 tx=0x7f762c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.702+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c00eec0 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c00cbc0 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7630009450 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c013470 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7640152b20 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f762c005970 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.703+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f762c005c20 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.704+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7640152980 con 0x7f7640159e70 2024-08-17T02:28:52.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.706+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f7640152980 con 0x7f7640159e70 2024-08-17T02:28:52.711 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:52.711+0000 7f070b413ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:28:52.734 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:52.733+0000 7f1c46656ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:28:52.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.780+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "75ab4ea1-8a49-47a1-82c8-f2d4cf642a40", "id": 3} v 0) v1 -- 0x7f76400c80b0 con 0x7f7640159e70 2024-08-17T02:28:52.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.783+0000 7f7636000640 1 -- 172.21.15.177:0/2309984502 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "75ab4ea1-8a49-47a1-82c8-f2d4cf642a40", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f762c029020 con 0x7f7640159e70 2024-08-17T02:28:52.785 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-08-17T02:28:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 msgr2=0x7f76400c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f762c00ec80 tx=0x7f762c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 shutdown_connections 2024-08-17T02:28:52.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f764015a2c0 0x7f76400c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7640159e70 0x7f76400c82d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 --2- 172.21.15.177:0/2309984502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7640159aa0 0x7f7640151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.784+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 >> 172.21.15.177:0/2309984502 conn(0x7f7640099040 msgr2=0x7f76400cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.785+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 shutdown_connections 2024-08-17T02:28:52.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.785+0000 7f763fe00640 1 -- 172.21.15.177:0/2309984502 wait complete. 2024-08-17T02:28:52.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 6d2f7bdb-17af-42c3-879f-89a14600fed8 4 2024-08-17T02:28:52.876 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:52.875+0000 7f070b413ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:28:52.911 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:52.910+0000 7f1c46656ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:28:52.940 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:52.940+0000 7f070b413ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:28:52.968 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:52.967+0000 7f1c46656ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:28:52.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.986+0000 7f7611000640 1 Processor -- start 2024-08-17T02:28:52.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.986+0000 7f7611000640 1 -- start start 2024-08-17T02:28:52.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f7611000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f760c159b90 0x7f760c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f7611000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f760c0ca8a0 0x7f760c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f7611000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0cadc0 con 0x7f760c159f60 2024-08-17T02:28:52.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f7611000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0cb880 con 0x7f760c159b90 2024-08-17T02:28:52.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f7611000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0cd6e0 con 0x7f760c0ca8a0 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f760c0ca8a0 0x7f760c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f760c0ca8a0 0x7f760c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59826/0 (socket says 172.21.15.177:59826) 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 -- 172.21.15.177:0/3745850582 learned_addr learned my addr 172.21.15.177:0/3745850582 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760b400640 1 --2- 172.21.15.177:0/3745850582 >> v2:172.21.15.110:3300/0 conn(0x7f760c159b90 0x7f760c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 -- 172.21.15.177:0/3745850582 >> v2:172.21.15.110:3300/0 conn(0x7f760c159b90 msgr2=0x7f760c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 --2- 172.21.15.177:0/3745850582 >> v2:172.21.15.110:3300/0 conn(0x7f760c159b90 0x7f760c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.987+0000 7f760aa00640 1 -- 172.21.15.177:0/3745850582 >> v1:172.21.15.110:6789/0 conn(0x7f760c159f60 legacy=0x7f760c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.988+0000 7f760aa00640 1 -- 172.21.15.177:0/3745850582 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0cb060 con 0x7f760c0ca8a0 2024-08-17T02:28:52.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.988+0000 7f760aa00640 1 --2- 172.21.15.177:0/3745850582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0cc590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f760c09d9c0 tx=0x7f75f80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c4a05828e38c47c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f760a000640 1 -- 172.21.15.177:0/3745850582 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f802ae80 con 0x7f760c0ca8a0 2024-08-17T02:28:52.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f760a000640 1 -- 172.21.15.177:0/3745850582 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8032440 con 0x7f760c0ca8a0 2024-08-17T02:28:52.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f760a000640 1 -- 172.21.15.177:0/3745850582 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8032800 con 0x7f760c0ca8a0 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 -- 172.21.15.177:0/3745850582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 msgr2=0x7f760c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 --2- 172.21.15.177:0/3745850582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0cc590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f760c09d9c0 tx=0x7f75f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 -- 172.21.15.177:0/3745850582 shutdown_connections 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 --2- 172.21.15.177:0/3745850582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0cc590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 --2- 172.21.15.177:0/3745850582 >> v2:172.21.15.110:3300/0 conn(0x7f760c159b90 0x7f760c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.989+0000 7f7611000640 1 -- 172.21.15.177:0/3745850582 >> 172.21.15.177:0/3745850582 conn(0x7f760c098e00 msgr2=0x7f760c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.990+0000 7f7611000640 1 -- 172.21.15.177:0/3745850582 shutdown_connections 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.990+0000 7f7611000640 1 -- 172.21.15.177:0/3745850582 wait complete. 2024-08-17T02:28:52.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.991+0000 7f7611000640 1 Processor -- start 2024-08-17T02:28:52.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.991+0000 7f7611000640 1 -- start start 2024-08-17T02:28:52.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 0x7f760c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 0x7f760c16b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0c5250 con 0x7f760c159f60 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b2e20 con 0x7f760c0ca8a0 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f7611000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0c4c90 con 0x7f760c159b90 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f760b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f760aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 0x7f760c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f760b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59832/0 (socket says 172.21.15.177:59832) 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f760b400640 1 -- 172.21.15.177:0/2948346441 learned_addr learned my addr 172.21.15.177:0/2948346441 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.992+0000 7f760be00640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 0x7f760c16b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 -- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 msgr2=0x7f760c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 -- 172.21.15.177:0/2948346441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 msgr2=0x7f760c16b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 0x7f760c16b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 -- 172.21.15.177:0/2948346441 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f8009450 con 0x7f760c159b90 2024-08-17T02:28:52.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760be00640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 0x7f760c16b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:52.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f760aa00640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 0x7f760c0c87e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75f8031000 tx=0x7f75f8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:52.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8031c80 con 0x7f760c159b90 2024-08-17T02:28:52.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0c4f70 con 0x7f760c159b90 2024-08-17T02:28:52.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8031e00 con 0x7f760c159b90 2024-08-17T02:28:52.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f803d670 con 0x7f760c159b90 2024-08-17T02:28:52.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.993+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c1550f0 con 0x7f760c159b90 2024-08-17T02:28:52.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.995+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0b2f90 con 0x7f760c159b90 2024-08-17T02:28:52.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.995+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f75f8039040 con 0x7f760c159b90 2024-08-17T02:28:52.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.995+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f75f80469f0 con 0x7f760c159b90 2024-08-17T02:28:53.000 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:53.000+0000 7f070b413ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:28:53.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:52.999+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f75f8037070 con 0x7f760c159b90 2024-08-17T02:28:53.036 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:53.034+0000 7f1c46656ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:28:53.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.073+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6d2f7bdb-17af-42c3-879f-89a14600fed8", "id": 4} v 0) v1 -- 0x7f760c071050 con 0x7f760c159b90 2024-08-17T02:28:53.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.077+0000 7f7602a00640 1 -- 172.21.15.177:0/2948346441 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6d2f7bdb-17af-42c3-879f-89a14600fed8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f75f80464a0 con 0x7f760c159b90 2024-08-17T02:28:53.079 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-08-17T02:28:53.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 msgr2=0x7f760c0c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 0x7f760c0c87e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f75f8031000 tx=0x7f75f8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 shutdown_connections 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760c159f60 0x7f760c16b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f760c159b90 0x7f760c0c87e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.078+0000 7f7611000640 1 --2- 172.21.15.177:0/2948346441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f760c0ca8a0 0x7f760c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.079+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 >> 172.21.15.177:0/2948346441 conn(0x7f760c098e00 msgr2=0x7f760c156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.079+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 shutdown_connections 2024-08-17T02:28:53.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.079+0000 7f7611000640 1 -- 172.21.15.177:0/2948346441 wait complete. 2024-08-17T02:28:53.099 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 1cba7f31-b97d-47b9-8c6a-1984822822bc 5 2024-08-17T02:28:53.106 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:53.106+0000 7f070b413ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:28:53.155 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:53.153+0000 7f1c46656ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:28:53.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.241+0000 7f173ea00640 1 Processor -- start 2024-08-17T02:28:53.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.241+0000 7f173ea00640 1 -- start start 2024-08-17T02:28:53.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17380ca770 0x7f17380c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173806f240 con 0x7f17380ca2f0 2024-08-17T02:28:53.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17380cf410 con 0x7f1738158ea0 2024-08-17T02:28:53.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ea00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17380c6f20 con 0x7f17380ca770 2024-08-17T02:28:53.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f1737e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1738158ea0 0x7f17380d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47850/0 (socket says 172.21.15.177:47850) 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f1737e00640 1 -- 172.21.15.177:0/929528253 learned_addr learned my addr 172.21.15.177:0/929528253 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ca00640 1 --2- 172.21.15.177:0/929528253 >> v2:172.21.15.177:3300/0 conn(0x7f17380ca770 0x7f17380c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f1736a00640 1 -- 172.21.15.177:0/929528253 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483288064 0 0) 0x7f17380cf410 con 0x7f1738158ea0 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ca00640 1 -- 172.21.15.177:0/929528253 >> v1:172.21.15.177:6789/0 conn(0x7f1738158ea0 legacy=0x7f17380d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ca00640 1 -- 172.21.15.177:0/929528253 >> v1:172.21.15.110:6789/0 conn(0x7f17380ca2f0 legacy=0x7f17380c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.243+0000 7f173ca00640 1 -- 172.21.15.177:0/929528253 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17380d0b70 con 0x7f17380ca770 2024-08-17T02:28:53.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.245+0000 7f173ca00640 1 --2- 172.21.15.177:0/929528253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380c7a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e60 tx=0x7f1730009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9947d78d1213de87 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.245+0000 7f1736a00640 1 -- 172.21.15.177:0/929528253 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730007550 con 0x7f17380ca770 2024-08-17T02:28:53.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.245+0000 7f1736a00640 1 -- 172.21.15.177:0/929528253 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173002d050 con 0x7f17380ca770 2024-08-17T02:28:53.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.245+0000 7f1736a00640 1 -- 172.21.15.177:0/929528253 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300078e0 con 0x7f17380ca770 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 -- 172.21.15.177:0/929528253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 msgr2=0x7f17380c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 --2- 172.21.15.177:0/929528253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380c7a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1730009e60 tx=0x7f1730009780 comp rx=0 tx=0).stop 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 -- 172.21.15.177:0/929528253 shutdown_connections 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 --2- 172.21.15.177:0/929528253 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380c7a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 -- 172.21.15.177:0/929528253 >> 172.21.15.177:0/929528253 conn(0x7f173806eb90 msgr2=0x7f17380cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 -- 172.21.15.177:0/929528253 shutdown_connections 2024-08-17T02:28:53.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.246+0000 7f173ea00640 1 -- 172.21.15.177:0/929528253 wait complete. 2024-08-17T02:28:53.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.247+0000 7f173ea00640 1 Processor -- start 2024-08-17T02:28:53.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.247+0000 7f173ea00640 1 -- start start 2024-08-17T02:28:53.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 0x7f1738154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 0x7f17380c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c3b90 con 0x7f1738158ea0 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c3e30 con 0x7f17380ca770 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f173ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c4110 con 0x7f17380ca2f0 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.248+0000 7f1737400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 0x7f1738154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f173ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 0x7f17380c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59860/0 (socket says 172.21.15.177:59860) 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 -- 172.21.15.177:0/1735626582 learned_addr learned my addr 172.21.15.177:0/1735626582 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 -- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 msgr2=0x7f1738154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 0x7f1738154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 -- 172.21.15.177:0/1735626582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 msgr2=0x7f17380c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 0x7f17380c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 -- 172.21.15.177:0/1735626582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009a20 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737e00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 0x7f1738154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f173ca00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 0x7f17380c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.249+0000 7f1737400640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f172400c7e0 tx=0x7f1724007eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172400a640 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172400a7e0 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172400aba0 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17380c43f0 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1738154b80 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1724012420 con 0x7f17380ca770 2024-08-17T02:28:53.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.250+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f1724011380 con 0x7f17380ca770 2024-08-17T02:28:53.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.251+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1738071050 con 0x7f17380ca770 2024-08-17T02:28:53.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.253+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f17240126d0 con 0x7f17380ca770 2024-08-17T02:28:53.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.327+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1cba7f31-b97d-47b9-8c6a-1984822822bc", "id": 5} v 0) v1 -- 0x7f17380cf600 con 0x7f17380ca770 2024-08-17T02:28:53.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.330+0000 7f172f400640 1 -- 172.21.15.177:0/1735626582 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1cba7f31-b97d-47b9-8c6a-1984822822bc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1724012870 con 0x7f17380ca770 2024-08-17T02:28:53.332 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 msgr2=0x7f17380b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f172400c7e0 tx=0x7f1724007eb0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 shutdown_connections 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1738158ea0 0x7f17380c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17380ca770 0x7f17380b37c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 --2- 172.21.15.177:0/1735626582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17380ca2f0 0x7f1738154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.331+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 >> 172.21.15.177:0/1735626582 conn(0x7f173806eb90 msgr2=0x7f17380b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.332+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 shutdown_connections 2024-08-17T02:28:53.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.332+0000 7f173ea00640 1 -- 172.21.15.177:0/1735626582 wait complete. 2024-08-17T02:28:53.347 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 0aaf8ffb-a370-4958-be37-ed7671be64cd 6 2024-08-17T02:28:53.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.491+0000 7fdba2000640 1 Processor -- start 2024-08-17T02:28:53.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.491+0000 7fdba2000640 1 -- start start 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 0x7fdb9c0ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba2000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0cad60 con 0x7fdb9c159e70 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba2000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0c4b90 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba2000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0ce630 con 0x7fdb9c159aa0 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba1600640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdb9c0ccf00 0x7fdb9c1629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47864/0 (socket says 172.21.15.177:47864) 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 0x7fdb9c0ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.492+0000 7fdba1600640 1 -- 172.21.15.177:0/3278187918 learned_addr learned my addr 172.21.15.177:0/3278187918 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-08-17T02:28:53.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.493+0000 7fdba0c00640 1 -- 172.21.15.177:0/3278187918 >> v1:172.21.15.177:6789/0 conn(0x7fdb9c0ccf00 legacy=0x7fdb9c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.493+0000 7fdba0c00640 1 -- 172.21.15.177:0/3278187918 >> v1:172.21.15.110:6789/0 conn(0x7fdb9c159e70 legacy=0x7fdb9c0cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.493+0000 7fdba0c00640 1 -- 172.21.15.177:0/3278187918 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0ce910 con 0x7fdb9c159aa0 2024-08-17T02:28:53.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.493+0000 7fdb9b400640 1 -- 172.21.15.177:0/3278187918 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082211213 0 0) 0x7fdb9c0cad60 con 0x7fdb9c159e70 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdba0c00640 1 --2- 172.21.15.177:0/3278187918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 0x7fdb9c0ce050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009880 tx=0x7fdb900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=907b4078d5a2b95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdb9b400640 1 -- 172.21.15.177:0/3278187918 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9002ae10 con 0x7fdb9c159aa0 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdb9b400640 1 -- 172.21.15.177:0/3278187918 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90032440 con 0x7fdb9c159aa0 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdb9b400640 1 -- 172.21.15.177:0/3278187918 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb900327e0 con 0x7fdb9c159aa0 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdba2000640 1 -- 172.21.15.177:0/3278187918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 msgr2=0x7fdb9c0ce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.494+0000 7fdba2000640 1 --2- 172.21.15.177:0/3278187918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 0x7fdb9c0ce050 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb90009880 tx=0x7fdb900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.495+0000 7fdba2000640 1 -- 172.21.15.177:0/3278187918 shutdown_connections 2024-08-17T02:28:53.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.495+0000 7fdba2000640 1 --2- 172.21.15.177:0/3278187918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c159aa0 0x7fdb9c0ce050 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.495+0000 7fdba2000640 1 -- 172.21.15.177:0/3278187918 >> 172.21.15.177:0/3278187918 conn(0x7fdb9c099040 msgr2=0x7fdb9c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.495+0000 7fdba2000640 1 -- 172.21.15.177:0/3278187918 shutdown_connections 2024-08-17T02:28:53.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.495+0000 7fdba2000640 1 -- 172.21.15.177:0/3278187918 wait complete. 2024-08-17T02:28:53.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.496+0000 7fdba2000640 1 Processor -- start 2024-08-17T02:28:53.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.496+0000 7fdba2000640 1 -- start start 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 0x7fdb9c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9c159e70 0x7fdb9c16c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c16c470 con 0x7fdb9c159e70 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1474e0 con 0x7fdb9c159aa0 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba2000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c76f0 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 0x7fdb9c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36656/0 (socket says 172.21.15.177:36656) 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba0c00640 1 -- 172.21.15.177:0/1041625183 learned_addr learned my addr 172.21.15.177:0/1041625183 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.497+0000 7fdba1600640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9c159e70 0x7fdb9c16c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 -- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 msgr2=0x7fdb9c0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 0x7fdb9c0c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 -- 172.21.15.177:0/1041625183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9c159e70 msgr2=0x7fdb9c16c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9c159e70 0x7fdb9c16c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 -- 172.21.15.177:0/1041625183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb90009390 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdb9be00640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 0x7fdb9c0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba0c00640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097d0 tx=0x7fdb90032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb90031b30 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb90031c90 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9003d670 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.498+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0c79d0 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.499+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c16c100 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.499+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdb90039040 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.499+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdb9003dd30 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.500+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c071050 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.502+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdb90042070 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.551 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:53.550+0000 7f070b413ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:28:53.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.576+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0aaf8ffb-a370-4958-be37-ed7671be64cd", "id": 6} v 0) v1 -- 0x7fdb9c06f480 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.580+0000 7fdb8fe00640 1 -- 172.21.15.177:0/1041625183 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0aaf8ffb-a370-4958-be37-ed7671be64cd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb90037070 con 0x7fdb9c0ccf00 2024-08-17T02:28:53.582 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-08-17T02:28:53.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 msgr2=0x7fdb9c146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdb900097d0 tx=0x7fdb90032000 comp rx=0 tx=0).stop 2024-08-17T02:28:53.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 shutdown_connections 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb9c159e70 0x7fdb9c16c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c159aa0 0x7fdb9c0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 --2- 172.21.15.177:0/1041625183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c0ccf00 0x7fdb9c146fa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.581+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 >> 172.21.15.177:0/1041625183 conn(0x7fdb9c099040 msgr2=0x7fdb9c157850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.582+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 shutdown_connections 2024-08-17T02:28:53.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.582+0000 7fdba2000640 1 -- 172.21.15.177:0/1041625183 wait complete. 2024-08-17T02:28:53.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 70d8658b-d58a-48ee-b61c-3aeeae046556 7 2024-08-17T02:28:53.629 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:53.628+0000 7f1c46656ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:28:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.740+0000 7f37a1e00640 1 Processor -- start 2024-08-17T02:28:53.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.740+0000 7f37a1e00640 1 -- start start 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f379c159b90 0x7f379c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0cadc0 con 0x7f379c0ca8a0 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0cb060 con 0x7f379c0ccca0 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0cb880 con 0x7f379c159b90 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f379c0ccca0 0x7f379c162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:47870/0 (socket says 172.21.15.177:47870) 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a1400640 1 -- 172.21.15.177:0/30118382 learned_addr learned my addr 172.21.15.177:0/30118382 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-08-17T02:28:53.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.741+0000 7f37a0a00640 1 --2- 172.21.15.177:0/30118382 >> v2:172.21.15.110:3300/0 conn(0x7f379c159b90 0x7f379c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.742+0000 7f379b400640 1 -- 172.21.15.177:0/30118382 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783042113 0 0) 0x7f379c0cadc0 con 0x7f379c0ca8a0 2024-08-17T02:28:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.742+0000 7f37a0a00640 1 -- 172.21.15.177:0/30118382 >> v1:172.21.15.177:6789/0 conn(0x7f379c0ccca0 legacy=0x7f379c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.742+0000 7f37a0a00640 1 -- 172.21.15.177:0/30118382 >> v1:172.21.15.110:6789/0 conn(0x7f379c0ca8a0 legacy=0x7f379c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.742+0000 7f37a0a00640 1 -- 172.21.15.177:0/30118382 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0cb300 con 0x7f379c159b90 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.743+0000 7f37a0a00640 1 --2- 172.21.15.177:0/30118382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c159b90 0x7f379c0ca360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37900097d0 tx=0x7f37900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8154e2e1d2df3e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.743+0000 7f379b400640 1 -- 172.21.15.177:0/30118382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379002ac80 con 0x7f379c159b90 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.743+0000 7f379b400640 1 -- 172.21.15.177:0/30118382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379002ade0 con 0x7f379c159b90 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.743+0000 7f379b400640 1 -- 172.21.15.177:0/30118382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790032670 con 0x7f379c159b90 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 -- 172.21.15.177:0/30118382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c159b90 msgr2=0x7f379c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 --2- 172.21.15.177:0/30118382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c159b90 0x7f379c0ca360 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f37900097d0 tx=0x7f37900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 -- 172.21.15.177:0/30118382 shutdown_connections 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 --2- 172.21.15.177:0/30118382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c159b90 0x7f379c0ca360 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 -- 172.21.15.177:0/30118382 >> 172.21.15.177:0/30118382 conn(0x7f379c098e00 msgr2=0x7f379c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 -- 172.21.15.177:0/30118382 shutdown_connections 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.744+0000 7f37a1e00640 1 -- 172.21.15.177:0/30118382 wait complete. 2024-08-17T02:28:53.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.745+0000 7f37a1e00640 1 Processor -- start 2024-08-17T02:28:53.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.745+0000 7f37a1e00640 1 -- start start 2024-08-17T02:28:53.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 0x7f379c0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c4c30 con 0x7f379c0ccca0 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c8b10 con 0x7f379c159b90 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c8df0 con 0x7f379c0ca8a0 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.746+0000 7f37a0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36662/0 (socket says 172.21.15.177:36662) 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 -- 172.21.15.177:0/2628289018 learned_addr learned my addr 172.21.15.177:0/2628289018 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:59886/0 (socket says 172.21.15.177:59886) 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f379be00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 0x7f379c0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:53.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 -- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 msgr2=0x7f379c0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 -- 172.21.15.177:0/2628289018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 msgr2=0x7f379c0ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 0x7f379c0ce720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 -- 172.21.15.177:0/2628289018 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790009390 con 0x7f379c0ca8a0 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a1400640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f379be00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 0x7f379c0ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:53.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.747+0000 7f37a0a00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3790009360 tx=0x7f3790032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:53.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790031800 con 0x7f379c0ca8a0 2024-08-17T02:28:53.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3790031960 con 0x7f379c0ca8a0 2024-08-17T02:28:53.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790031d20 con 0x7f379c0ca8a0 2024-08-17T02:28:53.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0c45e0 con 0x7f379c0ca8a0 2024-08-17T02:28:53.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c170190 con 0x7f379c0ca8a0 2024-08-17T02:28:53.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f3790039040 con 0x7f379c0ca8a0 2024-08-17T02:28:53.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.748+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f3790041030 con 0x7f379c0ca8a0 2024-08-17T02:28:53.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.749+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c170350 con 0x7f379c0ca8a0 2024-08-17T02:28:53.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.751+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f379004b060 con 0x7f379c0ca8a0 2024-08-17T02:28:53.817 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:53.816+0000 7f070b413ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:28:53.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.825+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "70d8658b-d58a-48ee-b61c-3aeeae046556", "id": 7} v 0) v1 -- 0x7f379c071050 con 0x7f379c0ca8a0 2024-08-17T02:28:53.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.829+0000 7f378fe00640 1 -- 172.21.15.177:0/2628289018 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "70d8658b-d58a-48ee-b61c-3aeeae046556", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3790037070 con 0x7f379c0ca8a0 2024-08-17T02:28:53.833 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 msgr2=0x7f379c16fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3790009360 tx=0x7f3790032000 comp rx=0 tx=0).stop 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 shutdown_connections 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f379c159b90 0x7f379c0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0ccca0 0x7f379c0ce720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 --2- 172.21.15.177:0/2628289018 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f379c0ca8a0 0x7f379c16fc50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 >> 172.21.15.177:0/2628289018 conn(0x7f379c098e00 msgr2=0x7f379c156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 shutdown_connections 2024-08-17T02:28:53.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-08-17T02:28:53.830+0000 7f37a1e00640 1 -- 172.21.15.177:0/2628289018 wait complete. 2024-08-17T02:28:53.845 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:28:53.846 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:28:53.850 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:28:53.850 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:28:53.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:28:53.853 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:28:53.854 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:28:53.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:28:53.858 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:28:53.858 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:28:53.858 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:28:53.863 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:28:53.863 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:28:53.863 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:28:53.883 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:53.883+0000 7f070b413ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:28:53.889 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:28:53.889 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:28:53.889 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:28:53.892 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:28:53.893 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:28:53.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:28:53.896 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:28:53.896 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:28:53.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:28:53.901 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:28:53.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:53.914 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:53.912+0000 7f1c46656ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:28:54.011 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.010+0000 7f1c46656ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:28:54.045 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.044+0000 7f070b413ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:28:54.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.101+0000 7fd6f7200640 1 Processor -- start 2024-08-17T02:28:54.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.101+0000 7fd6f7200640 1 -- start start 2024-08-17T02:28:54.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 0x7fd6f00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6f00ccad0 0x7fd6f0162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f7200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f00cadc0 con 0x7fd6f0159ca0 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f7200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f00cd6e0 con 0x7fd6f00ccad0 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00ccf70 con 0x7fd6f00ceb40 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f6800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6f00ccad0 0x7fd6f0162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f5400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 0x7fd6f00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f5e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd6f0159ca0 0x7fd6f00ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:48312/0 (socket says 172.21.15.110:48312) 2024-08-17T02:28:54.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.102+0000 7fd6f5e00640 1 -- 172.21.15.110:0/3871573032 learned_addr learned my addr 172.21.15.110:0/3871573032 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f6800640 1 -- 172.21.15.110:0/3871573032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 msgr2=0x7fd6f00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f6800640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 0x7fd6f00cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f6800640 1 -- 172.21.15.110:0/3871573032 >> v1:172.21.15.177:6789/0 conn(0x7fd6f0159ca0 legacy=0x7fd6f00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f6800640 1 -- 172.21.15.110:0/3871573032 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00cb060 con 0x7fd6f00ccad0 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f4a00640 1 -- 172.21.15.110:0/3871573032 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749319802 0 0) 0x7fd6f00cadc0 con 0x7fd6f0159ca0 2024-08-17T02:28:54.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.103+0000 7fd6f5400640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 0x7fd6f00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.104+0000 7fd6f6800640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00ccad0 0x7fd6f0162860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b591ae1e0a75dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f4a00640 1 -- 172.21.15.110:0/3871573032 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007550 con 0x7fd6f00ccad0 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f4a00640 1 -- 172.21.15.110:0/3871573032 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec02d050 con 0x7fd6f00ccad0 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f4a00640 1 -- 172.21.15.110:0/3871573032 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0078e0 con 0x7fd6f00ccad0 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f7200640 1 -- 172.21.15.110:0/3871573032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00ccad0 msgr2=0x7fd6f0162860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f7200640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00ccad0 0x7fd6f0162860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009e60 tx=0x7fd6ec009780 comp rx=0 tx=0).stop 2024-08-17T02:28:54.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f7200640 1 -- 172.21.15.110:0/3871573032 shutdown_connections 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.105+0000 7fd6f7200640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f00ccad0 0x7fd6f0162860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.106+0000 7fd6f7200640 1 --2- 172.21.15.110:0/3871573032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ceb40 0x7fd6f00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.106+0000 7fd6f7200640 1 -- 172.21.15.110:0/3871573032 >> 172.21.15.110:0/3871573032 conn(0x7fd6f0098e00 msgr2=0x7fd6f006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.106+0000 7fd6f7200640 1 -- 172.21.15.110:0/3871573032 shutdown_connections 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.106+0000 7fd6f7200640 1 -- 172.21.15.110:0/3871573032 wait complete. 2024-08-17T02:28:54.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.107+0000 7fd6f7200640 1 Processor -- start 2024-08-17T02:28:54.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.107+0000 7fd6f7200640 1 -- start start 2024-08-17T02:28:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f00ceb40 0x7fd6f00c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f0159ca0 0x7fd6f0168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00ca140 con 0x7fd6f0159ca0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00c54e0 con 0x7fd6f00ceb40 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f00c5760 con 0x7fd6f00ccad0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.108+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f0159ca0 0x7fd6f0168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:57856/0 (socket says 172.21.15.110:57856) 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 -- 172.21.15.110:0/4105735020 learned_addr learned my addr 172.21.15.110:0/4105735020 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5400640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f00ceb40 0x7fd6f00c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 -- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f00ceb40 msgr2=0x7fd6f00c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f00ceb40 0x7fd6f00c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 -- 172.21.15.110:0/4105735020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f0159ca0 msgr2=0x7fd6f0168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f0159ca0 0x7fd6f0168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 -- 172.21.15.110:0/4105735020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0009390 con 0x7fd6f00ccad0 2024-08-17T02:28:54.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6f5e00640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c510 tx=0x7fd6e400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.109+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4005aa0 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e4005c00 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40070d0 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec009a20 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f00c5d20 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd6e4007500 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.110+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fd6e401c440 con 0x7fd6f00ccad0 2024-08-17T02:28:54.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.111+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f00cb240 con 0x7fd6f00ccad0 2024-08-17T02:28:54.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.113+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fd6e4017070 con 0x7fd6f00ccad0 2024-08-17T02:28:54.140 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.138+0000 7f1c46656ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:28:54.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.176+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6f0071050 con 0x7fd6f00ccad0 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.176+0000 7fd6e9600640 1 -- 172.21.15.110:0/4105735020 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fd6e4024410 con 0x7fd6f00ccad0 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:28:54.177 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":10,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:28:53.828029+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.177+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 msgr2=0x7fd6f00c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.177+0000 7fd6f7200640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400c510 tx=0x7fd6e400c910 comp rx=0 tx=0).stop 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 shutdown_connections 2024-08-17T02:28:54.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6f0159ca0 0x7fd6f0168ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6f00ceb40 0x7fd6f00c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 --2- 172.21.15.110:0/4105735020 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd6f00ccad0 0x7fd6f00c9c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 >> 172.21.15.110:0/4105735020 conn(0x7fd6f0098e00 msgr2=0x7fd6f00cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 shutdown_connections 2024-08-17T02:28:54.179 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:28:54.178+0000 7fd6f7200640 1 -- 172.21.15.110:0/4105735020 wait complete. 2024-08-17T02:28:54.192 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:28:54.192 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:28:54.336 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.336+0000 7f070b413ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:28:54.405 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.405+0000 7f070b413ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:28:54.427 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.427+0000 7f1c46656ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:28:54.480 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.479+0000 7f1c46656ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:28:54.525 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-08-17T02:28:54.524+0000 7f83fb22d2c0 -1 Falling back to public interface 2024-08-17T02:28:54.536 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-08-17T02:28:54.536+0000 7f110462f2c0 -1 Falling back to public interface 2024-08-17T02:28:54.540 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-08-17T02:28:54.540+0000 7f29945212c0 -1 Falling back to public interface 2024-08-17T02:28:54.547 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-08-17T02:28:54.547+0000 7f5da70092c0 -1 Falling back to public interface 2024-08-17T02:28:54.569 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-08-17T02:28:54.569+0000 7fc2782372c0 -1 Falling back to public interface 2024-08-17T02:28:54.569 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-08-17T02:28:54.569+0000 7f34061202c0 -1 Falling back to public interface 2024-08-17T02:28:54.574 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-08-17T02:28:54.574+0000 7f3565d312c0 -1 Falling back to public interface 2024-08-17T02:28:54.580 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-08-17T02:28:54.580+0000 7ff1c700f2c0 -1 Falling back to public interface 2024-08-17T02:28:54.590 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.590+0000 7f070b413ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:28:54.646 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.646+0000 7f070b413ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:28:54.666 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.666+0000 7f1c46656ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:28:54.722 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.721+0000 7f1c46656ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:28:54.722 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.722+0000 7f070b413ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:28:54.771 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:54.771+0000 7f070b413ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:28:54.800 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.799+0000 7f1c46656ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:28:54.851 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:54.850+0000 7f1c46656ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:28:54.998 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:55.129 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.129+0000 7f05b6e00640 1 Processor -- start 2024-08-17T02:28:55.129 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.129+0000 7f05b6e00640 1 -- start start 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00ad8e0 0x7f05b00d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 0x7f05b00b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05b00b2c60 0x7f05b00b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00b3620 con 0x7f05b00b2c60 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b00af240 con 0x7f05b00b0ac0 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b6e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00afa20 con 0x7f05b00ad8e0 2024-08-17T02:28:55.131 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b4e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05b00b2c60 0x7f05b00b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b4e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05b00b2c60 0x7f05b00b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54734/0 (socket says 172.21.15.110:54734) 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.130+0000 7f05b4e00640 1 -- 172.21.15.110:0/522252410 learned_addr learned my addr 172.21.15.110:0/522252410 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05af400640 1 --2- 172.21.15.110:0/522252410 >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 0x7f05b00b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05afe00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00ad8e0 0x7f05b00d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05b4e00640 1 -- 172.21.15.110:0/522252410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00ad8e0 msgr2=0x7f05b00d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05b4e00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00ad8e0 0x7f05b00d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05b4e00640 1 -- 172.21.15.110:0/522252410 >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 msgr2=0x7f05b00b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05b4e00640 1 --2- 172.21.15.110:0/522252410 >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 0x7f05b00b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05b4e00640 1 -- 172.21.15.110:0/522252410 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b00afd00 con 0x7f05b00b2c60 2024-08-17T02:28:55.132 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.131+0000 7f05af400640 1 --2- 172.21.15.110:0/522252410 >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 0x7f05b00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:55.133 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.132+0000 7f05b4e00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00b2c60 0x7f05b00b30e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05b0088cc0 tx=0x7f05a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5cc1855ddb07ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:55.133 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.132+0000 7f05aea00640 1 -- 172.21.15.110:0/522252410 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8031400 con 0x7f05b00b2c60 2024-08-17T02:28:55.133 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.132+0000 7f05aea00640 1 -- 172.21.15.110:0/522252410 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a802d050 con 0x7f05b00b2c60 2024-08-17T02:28:55.133 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.132+0000 7f05aea00640 1 -- 172.21.15.110:0/522252410 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80317d0 con 0x7f05b00b2c60 2024-08-17T02:28:55.133 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 -- 172.21.15.110:0/522252410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00b2c60 msgr2=0x7f05b00b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00b2c60 0x7f05b00b30e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05b0088cc0 tx=0x7f05a8009840 comp rx=0 tx=0).stop 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 -- 172.21.15.110:0/522252410 shutdown_connections 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00b2c60 0x7f05b00b30e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 --2- 172.21.15.110:0/522252410 >> v2:172.21.15.177:3300/0 conn(0x7f05b00b0ac0 0x7f05b00b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 --2- 172.21.15.110:0/522252410 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00ad8e0 0x7f05b00d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 -- 172.21.15.110:0/522252410 >> 172.21.15.110:0/522252410 conn(0x7f05b006ec90 msgr2=0x7f05b00cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 -- 172.21.15.110:0/522252410 shutdown_connections 2024-08-17T02:28:55.134 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.133+0000 7f05b6e00640 1 -- 172.21.15.110:0/522252410 wait complete. 2024-08-17T02:28:55.135 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.134+0000 7f05b6e00640 1 Processor -- start 2024-08-17T02:28:55.135 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.134+0000 7f05b6e00640 1 -- start start 2024-08-17T02:28:55.136 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.136 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 0x7f05b00cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.136 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00b2c60 0x7f05b00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:55.136 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b00cc0d0 con 0x7f05b00ad8e0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b009d2d0 con 0x7f05b00b0ac0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05b6e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b009d5b0 con 0x7f05b00b2c60 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.135+0000 7f05afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54736/0 (socket says 172.21.15.110:54736) 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 -- 172.21.15.110:0/4228673135 learned_addr learned my addr 172.21.15.110:0/4228673135 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05af400640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 0x7f05b00cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05b4e00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00b2c60 0x7f05b00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 -- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00b2c60 msgr2=0x7f05b00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00b2c60 0x7f05b00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 -- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 msgr2=0x7f05b00cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 0x7f05b00cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 -- 172.21.15.110:0/4228673135 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8009ae0 con 0x7f05b00ad8e0 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05af400640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 0x7f05b00cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:55.137 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05afe00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05a000d890 tx=0x7f05a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:55.138 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a000de20 con 0x7f05b00ad8e0 2024-08-17T02:28:55.138 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a00098b0 con 0x7f05b00ad8e0 2024-08-17T02:28:55.138 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b016a0d0 con 0x7f05b00ad8e0 2024-08-17T02:28:55.139 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.136+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0009c50 con 0x7f05b00ad8e0 2024-08-17T02:28:55.139 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.137+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b0169600 con 0x7f05b00ad8e0 2024-08-17T02:28:55.139 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.137+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f05a0014620 con 0x7f05b00ad8e0 2024-08-17T02:28:55.139 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.137+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f05a0009db0 con 0x7f05b00ad8e0 2024-08-17T02:28:55.139 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.138+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b016a550 con 0x7f05b00ad8e0 2024-08-17T02:28:55.140 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.140+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f05a0018020 con 0x7f05b00ad8e0 2024-08-17T02:28:55.202 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.202+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b0169f10 con 0x7f05b00ad8e0 2024-08-17T02:28:55.203 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.203+0000 7f05a7400640 1 -- 172.21.15.110:0/4228673135 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f05a002b020 con 0x7f05b00ad8e0 2024-08-17T02:28:55.203 INFO:teuthology.misc.health.smithi110.stdout: 2024-08-17T02:28:55.204 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":10,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:28:53.828029+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 msgr2=0x7f05b01690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05a000d890 tx=0x7f05a0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 shutdown_connections 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05b00b2c60 0x7f05b00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05b00b0ac0 0x7f05b00cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 --2- 172.21.15.110:0/4228673135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05b00ad8e0 0x7f05b01690c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 >> 172.21.15.110:0/4228673135 conn(0x7f05b006ec90 msgr2=0x7f05b01585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 shutdown_connections 2024-08-17T02:28:55.205 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:28:55.204+0000 7f05b6e00640 1 -- 172.21.15.110:0/4228673135 wait complete. 2024-08-17T02:28:55.216 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:28:55.306 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:55.306+0000 7f070b413ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:28:55.373 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:55.373+0000 7f1c46656ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:28:55.417 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:55.417+0000 7f070b413ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:28:55.492 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-08-17T02:28:55.492+0000 7f1c46656ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:28:56.440 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:56.439+0000 7f06efc00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:28:56.440 INFO:tasks.ceph.mgr.y.smithi110.stderr:2024-08-17T02:28:56.439+0000 7f06efc00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:28:58.061 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-08-17T02:28:58.060+0000 7f83fb22d2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:28:58.136 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-08-17T02:28:58.136+0000 7f34061202c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:28:58.154 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-08-17T02:28:58.154+0000 7f110462f2c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:28:58.178 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-08-17T02:28:58.178+0000 7f29945212c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:28:58.193 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-08-17T02:28:58.193+0000 7f5da70092c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:28:58.213 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-08-17T02:28:58.212+0000 7f3565d312c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:28:58.232 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-08-17T02:28:58.232+0000 7ff1c700f2c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:28:58.449 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-08-17T02:28:58.448+0000 7fc2782372c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:29:01.104 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-08-17T02:29:01.104+0000 7f5da0400640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:29:01.114 INFO:tasks.ceph.osd.1.smithi110.stderr:2024-08-17T02:29:01.111+0000 7f5d97800640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.124 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-08-17T02:29:01.124+0000 7f10fda00640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:29:01.130 INFO:tasks.ceph.osd.2.smithi110.stderr:2024-08-17T02:29:01.130+0000 7f10f4e00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.132 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-08-17T02:29:01.132+0000 7f83f6400640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:29:01.139 INFO:tasks.ceph.osd.0.smithi110.stderr:2024-08-17T02:29:01.139+0000 7f83eba00640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.158 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-08-17T02:29:01.158+0000 7f298dc00640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:29:01.163 INFO:tasks.ceph.osd.3.smithi110.stderr:2024-08-17T02:29:01.163+0000 7f2985000640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.291 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-08-17T02:29:01.290+0000 7ff1c2200640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:29:01.302 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-08-17T02:29:01.302+0000 7ff1b7800640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.321 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-08-17T02:29:01.321+0000 7f33ff800640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:29:01.329 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-08-17T02:29:01.328+0000 7f33f6c00640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.423 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-08-17T02:29:01.423+0000 7f355f400640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:29:01.428 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-08-17T02:29:01.428+0000 7f3556800640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:01.823 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-08-17T02:29:01.823+0000 7fc272000640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:29:01.828 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-08-17T02:29:01.828+0000 7fc269400640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:29:02.023 DEBUG:teuthology.orchestra.run.smithi110:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:02.162 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.161+0000 7f6fbac00640 1 Processor -- start 2024-08-17T02:29:02.162 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.162+0000 7f6fbac00640 1 -- start start 2024-08-17T02:29:02.163 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fbac00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fb40d0590 0x7f6fb40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.163 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fbac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40b30b0 con 0x7f6fb40cda00 2024-08-17T02:29:02.163 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fbac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb40ca940 con 0x7f6fb40cbec0 2024-08-17T02:29:02.163 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fbac00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb40cabe0 con 0x7f6fb40d0590 2024-08-17T02:29:02.163 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fb9800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6fb40cda00 0x7f6fb40b29a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40766/0 (socket says 172.21.15.110:40766) 2024-08-17T02:29:02.164 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fb9800640 1 -- 172.21.15.110:0/2082915949 learned_addr learned my addr 172.21.15.110:0/2082915949 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253469591 0 0) 0x7f6fb40b30b0 con 0x7f6fb40cda00 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f9c0034e0 con 0x7f6fb40cda00 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.163+0000 7f6fb8e00640 1 --2- 172.21.15.110:0/2082915949 >> v2:172.21.15.177:3300/0 conn(0x7f6fb40d0590 0x7f6fb40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1596706190 0 0) 0x7f6f9c0034e0 con 0x7f6fb40cda00 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 >> v2:172.21.15.177:3300/0 conn(0x7f6fb40d0590 msgr2=0x7f6fb40cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 --2- 172.21.15.110:0/2082915949 >> v2:172.21.15.177:3300/0 conn(0x7f6fb40d0590 0x7f6fb40cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 >> v1:172.21.15.177:6789/0 conn(0x7f6fb40cbec0 legacy=0x7f6fb40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40caec0 con 0x7f6fb40cda00 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f6fa8001470 con 0x7f6fb40cda00 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 >> v1:172.21.15.110:6789/0 conn(0x7f6fb40cda00 legacy=0x7f6fb40b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.166 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6f9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f9c004780 0x7f6f9c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f9c005250 0x7f6f9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40cabe0 con 0x7f6f9c005250 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c00c100 con 0x7f6f9c004780 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c00c2c0 con 0x7f6f9c0039d0 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6f9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb8e00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f9c004780 0x7f6f9c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fba200640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f9c005250 0x7f6f9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 -- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f9c004780 msgr2=0x7f6f9c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f9c004780 0x7f6f9c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 -- 172.21.15.110:0/2082915949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f9c005250 msgr2=0x7f6f9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.167 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f9c005250 0x7f6f9c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.168 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fb9800640 1 -- 172.21.15.110:0/2082915949 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0034e0 con 0x7f6f9c0039d0 2024-08-17T02:29:02.168 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fba200640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f9c005250 0x7f6f9c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:02.168 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.164+0000 7f6fba200640 1 -- 172.21.15.110:0/2082915949 reap_dead start 2024-08-17T02:29:02.168 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fb9800640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6f9c003de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c2d0 tx=0x7f6fa8001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36e0fc057e0065ae server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.170 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8005890 con 0x7f6f9c0039d0 2024-08-17T02:29:02.170 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa802e070 con 0x7f6f9c0039d0 2024-08-17T02:29:02.170 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fb3e00640 1 -- 172.21.15.110:0/2082915949 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8005a70 con 0x7f6f9c0039d0 2024-08-17T02:29:02.170 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fbac00640 1 -- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 msgr2=0x7f6f9c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.170 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fbac00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6f9c003de0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800c2d0 tx=0x7f6fa8001e50 comp rx=0 tx=0).stop 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fbac00640 1 -- 172.21.15.110:0/2082915949 shutdown_connections 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fbac00640 1 --2- 172.21.15.110:0/2082915949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6f9c003de0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.166+0000 7f6fbac00640 1 -- 172.21.15.110:0/2082915949 >> 172.21.15.110:0/2082915949 conn(0x7f6fb406ec90 msgr2=0x7f6fb40cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.167+0000 7f6fbac00640 1 -- 172.21.15.110:0/2082915949 shutdown_connections 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.167+0000 7f6fbac00640 1 -- 172.21.15.110:0/2082915949 wait complete. 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.168+0000 7f6fbac00640 1 Processor -- start 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.168+0000 7f6fbac00640 1 -- start start 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6fb4169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fb40c7660 0x7f6fb40c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c81f0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.171 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb416c4f0 con 0x7f6fb40c7660 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fbac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb40c7f10 con 0x7f6f9c0039d0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54858/0 (socket says 172.21.15.110:54858) 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 -- 172.21.15.110:0/3039201688 learned_addr learned my addr 172.21.15.110:0/3039201688 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb9800640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6fb4169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fba200640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fb40c7660 0x7f6fb40c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 -- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 msgr2=0x7f6fb4169210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6fb4169210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 -- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fb40c7660 msgr2=0x7f6fb40c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fb40c7660 0x7f6fb40c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.169+0000 7f6fb8e00640 1 -- 172.21.15.110:0/3039201688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4159510 con 0x7f6fb415bbe0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fb8e00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0010d00 tx=0x7f6fa0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.172 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa000eb80 con 0x7f6fb415bbe0 2024-08-17T02:29:02.173 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000ece0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.173 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0014680 con 0x7f6fb415bbe0 2024-08-17T02:29:02.173 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb41597f0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.173 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.170+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb40c7ab0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.173 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.171+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb40c7cd0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.174 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.172+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f6fa0014a30 con 0x7f6fb415bbe0 2024-08-17T02:29:02.174 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.173+0000 7f6fb0c00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 0x7f6f940675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.174 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.173+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f6fa0082590 con 0x7f6fb415bbe0 2024-08-17T02:29:02.174 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.173+0000 7f6fb9800640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 0x7f6f940675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.174 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.174+0000 7f6fb9800640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 0x7f6f940675a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8033000 tx=0x7f6fa8034000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.179 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.178+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6fb40c7cd0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.354 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.353+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb40c7cd0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.355 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.354+0000 7f6fb0c00640 1 -- 172.21.15.110:0/3039201688 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f6fb40c7cd0 con 0x7f6fb415bbe0 2024-08-17T02:29:02.355 INFO:teuthology.misc.health.smithi110.stdout: 2024-08-17T02:29:02.355 INFO:teuthology.misc.health.smithi110.stdout:{"epoch":14,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:02.110419+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:02.357 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.356+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 msgr2=0x7f6f940675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.357 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.356+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 0x7f6f940675a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8033000 tx=0x7f6fa8034000 comp rx=0 tx=0).stop 2024-08-17T02:29:02.357 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.356+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 msgr2=0x7f6fb416bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.357 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.356+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0010d00 tx=0x7f6fa0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 shutdown_connections 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6f940650f0 0x7f6f940675a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fb40c7660 0x7f6fb40c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb415bbe0 0x7f6fb416bfb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 --2- 172.21.15.110:0/3039201688 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f9c0039d0 0x7f6fb4169210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 >> 172.21.15.110:0/3039201688 conn(0x7f6fb406ec90 msgr2=0x7f6fb4068fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 shutdown_connections 2024-08-17T02:29:02.358 INFO:teuthology.misc.health.smithi110.stderr:2024-08-17T02:29:02.357+0000 7f6fbac00640 1 -- 172.21.15.110:0/3039201688 wait complete. 2024-08-17T02:29:02.369 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:29:02.369 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:29:02.369 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:29:02.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:29:02.373 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:29:02.373 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:29:02.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:29:02.377 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:29:02.377 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:29:02.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:29:02.382 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:29:02.382 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:29:02.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:29:02.386 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:29:02.386 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:29:02.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:02.498 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2024-08-17T02:29:02.504 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2024-08-17T02:29:02.505 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-08-17T02:29:02.510 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-08-17T02:29:02.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.543+0000 7f4ada800640 1 Processor -- start 2024-08-17T02:29:02.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.543+0000 7f4ada800640 1 -- start start 2024-08-17T02:29:02.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ada800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4ad40ada10 0x7f4ad40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ada800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40d0ab0 con 0x7f4ad40b38b0 2024-08-17T02:29:02.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ada800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad40b00c0 con 0x7f4ad40b1120 2024-08-17T02:29:02.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ada800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad40b0360 con 0x7f4ad40ada10 2024-08-17T02:29:02.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ad3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4ad40b38b0 0x7f4ad40aedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:40786/0 (socket says 172.21.15.110:40786) 2024-08-17T02:29:02.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ad3e00640 1 -- 172.21.15.110:0/3648975552 learned_addr learned my addr 172.21.15.110:0/3648975552 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:02.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.544+0000 7f4ad3400640 1 --2- 172.21.15.110:0/3648975552 >> v2:172.21.15.110:3300/0 conn(0x7f4ad40ada10 0x7f4ad40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.545+0000 7f4ad3400640 1 -- 172.21.15.110:0/3648975552 >> v1:172.21.15.177:6789/0 conn(0x7f4ad40b1120 legacy=0x7f4ad40b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.545+0000 7f4ad3400640 1 -- 172.21.15.110:0/3648975552 >> v1:172.21.15.110:6789/0 conn(0x7f4ad40b38b0 legacy=0x7f4ad40aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.545+0000 7f4ad2a00640 1 -- 172.21.15.110:0/3648975552 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334526601 0 0) 0x7f4ad40d0ab0 con 0x7f4ad40b38b0 2024-08-17T02:29:02.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.545+0000 7f4ad3400640 1 -- 172.21.15.110:0/3648975552 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad40b0640 con 0x7f4ad40ada10 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ad3400640 1 --2- 172.21.15.110:0/3648975552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40ada10 0x7f4ad40b2c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009850 tx=0x7f4ac40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4846a18f0943c95 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ad2a00640 1 -- 172.21.15.110:0/3648975552 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4032440 con 0x7f4ad40ada10 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ad2a00640 1 -- 172.21.15.110:0/3648975552 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac40325a0 con 0x7f4ad40ada10 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ad2a00640 1 -- 172.21.15.110:0/3648975552 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4032940 con 0x7f4ad40ada10 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ada800640 1 -- 172.21.15.110:0/3648975552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40ada10 msgr2=0x7f4ad40b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.546+0000 7f4ada800640 1 --2- 172.21.15.110:0/3648975552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40ada10 0x7f4ad40b2c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009850 tx=0x7f4ac40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.547+0000 7f4ada800640 1 -- 172.21.15.110:0/3648975552 shutdown_connections 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.547+0000 7f4ada800640 1 --2- 172.21.15.110:0/3648975552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40ada10 0x7f4ad40b2c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.547+0000 7f4ada800640 1 -- 172.21.15.110:0/3648975552 >> 172.21.15.110:0/3648975552 conn(0x7f4ad40cfdf0 msgr2=0x7f4ad40d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.547+0000 7f4ada800640 1 -- 172.21.15.110:0/3648975552 shutdown_connections 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.547+0000 7f4ada800640 1 -- 172.21.15.110:0/3648975552 wait complete. 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.548+0000 7f4ada800640 1 Processor -- start 2024-08-17T02:29:02.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.548+0000 7f4ada800640 1 -- start start 2024-08-17T02:29:02.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ad40b1120 0x7f4ad409c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40b38b0 0x7f4ad4148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad409cec0 con 0x7f4ad40b38b0 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad409d1a0 con 0x7f4ad40b1120 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ada800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad409d480 con 0x7f4ad40ada10 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ad3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4acaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ad40b1120 0x7f4ad409c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ad3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40b38b0 0x7f4ad4148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ad3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:58012/0 (socket says 172.21.15.110:58012) 2024-08-17T02:29:02.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.549+0000 7f4ad3400640 1 -- 172.21.15.110:0/339411433 learned_addr learned my addr 172.21.15.110:0/339411433 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:02.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 -- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ad40b1120 msgr2=0x7f4ad409c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ad40b1120 0x7f4ad409c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 -- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40b38b0 msgr2=0x7f4ad4148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40b38b0 0x7f4ad4148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 -- 172.21.15.110:0/339411433 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009390 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ad3400640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009360 tx=0x7f4ac4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4031b10 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac4031c70 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ada800640 1 -- 172.21.15.110:0/339411433 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad409d760 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac403b400 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.550+0000 7f4ada800640 1 -- 172.21.15.110:0/339411433 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad4148c80 con 0x7f4ad40ada10 2024-08-17T02:29:02.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.552+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad4064db0 con 0x7f4ad40ada10 2024-08-17T02:29:02.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.552+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f4ac4043030 con 0x7f4ad40ada10 2024-08-17T02:29:02.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.553+0000 7f4acb400640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 0x7f4ab0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.553+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f4ac4041070 con 0x7f4ad40ada10 2024-08-17T02:29:02.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.553+0000 7f4acaa00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 0x7f4ab0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.554+0000 7f4acaa00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 0x7f4ab0067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ad409a250 tx=0x7f4abc007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.558+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ac4070eb0 con 0x7f4ad40ada10 2024-08-17T02:29:02.734 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.734+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad409d8f0 con 0x7f4ad40ada10 2024-08-17T02:29:02.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.735+0000 7f4acb400640 1 -- 172.21.15.110:0/339411433 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10444 (secure 0 0 0) 0x7f4ac404b020 con 0x7f4ad40ada10 2024-08-17T02:29:02.736 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:02.736 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":14,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:02.110419+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 msgr2=0x7f4ab0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 0x7f4ab0067570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ad409a250 tx=0x7f4abc007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 msgr2=0x7f4ad4099d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4009360 tx=0x7f4ac4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 shutdown_connections 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4ab00650c0 0x7f4ab0067570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ad40b38b0 0x7f4ad4148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ad40b1120 0x7f4ad409c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 --2- 172.21.15.110:0/339411433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ad40ada10 0x7f4ad4099d10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 >> 172.21.15.110:0/339411433 conn(0x7f4ad40cfdf0 msgr2=0x7f4ad4067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 shutdown_connections 2024-08-17T02:29:02.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.737+0000 7f4ac3e00640 1 -- 172.21.15.110:0/339411433 wait complete. 2024-08-17T02:29:02.752 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-08-17T02:29:02.752 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:02.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.901+0000 7f93b0c00640 1 Processor -- start 2024-08-17T02:29:02.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.901+0000 7f93b0c00640 1 -- start start 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93b0c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac155550 0x7f93ac0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93b0c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f93ac06e080 0x7f93ac06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93b0c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac0afc10 con 0x7f93ac155180 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93b0c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac06ea00 con 0x7f93ac155550 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93b0c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac0af000 con 0x7f93ac06e080 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93a9400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac155550 0x7f93ac0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93a9400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f93ac155550 0x7f93ac0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54896/0 (socket says 172.21.15.110:54896) 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93a9400640 1 -- 172.21.15.110:0/4195988345 learned_addr learned my addr 172.21.15.110:0/4195988345 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.902+0000 7f93aa800640 1 --2- 172.21.15.110:0/4195988345 >> v2:172.21.15.177:3300/0 conn(0x7f93ac06e080 0x7f93ac06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.903+0000 7f93a9400640 1 -- 172.21.15.110:0/4195988345 >> v2:172.21.15.177:3300/0 conn(0x7f93ac06e080 msgr2=0x7f93ac06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.903+0000 7f93a9400640 1 --2- 172.21.15.110:0/4195988345 >> v2:172.21.15.177:3300/0 conn(0x7f93ac06e080 0x7f93ac06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.903+0000 7f93a9400640 1 -- 172.21.15.110:0/4195988345 >> v1:172.21.15.177:6789/0 conn(0x7f93ac155180 legacy=0x7f93ac0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.903+0000 7f93a9400640 1 -- 172.21.15.110:0/4195988345 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0af2e0 con 0x7f93ac155550 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.904+0000 7f93a9400640 1 --2- 172.21.15.110:0/4195988345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155550 0x7f93ac0aea20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0642c0 tx=0x7f93980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600c16aff31c07fe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.904+0000 7f93a8a00640 1 -- 172.21.15.110:0/4195988345 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939802ae80 con 0x7f93ac155550 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.904+0000 7f93a8a00640 1 -- 172.21.15.110:0/4195988345 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398032440 con 0x7f93ac155550 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.904+0000 7f93a8a00640 1 -- 172.21.15.110:0/4195988345 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398032800 con 0x7f93ac155550 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 -- 172.21.15.110:0/4195988345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155550 msgr2=0x7f93ac0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 --2- 172.21.15.110:0/4195988345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155550 0x7f93ac0aea20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0642c0 tx=0x7f93980091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 -- 172.21.15.110:0/4195988345 shutdown_connections 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 --2- 172.21.15.110:0/4195988345 >> v2:172.21.15.177:3300/0 conn(0x7f93ac06e080 0x7f93ac06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 --2- 172.21.15.110:0/4195988345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155550 0x7f93ac0aea20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 -- 172.21.15.110:0/4195988345 >> 172.21.15.110:0/4195988345 conn(0x7f93ac0cb9b0 msgr2=0x7f93ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 -- 172.21.15.110:0/4195988345 shutdown_connections 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.905+0000 7f93b0c00640 1 -- 172.21.15.110:0/4195988345 wait complete. 2024-08-17T02:29:02.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.906+0000 7f93b0c00640 1 Processor -- start 2024-08-17T02:29:02.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.906+0000 7f93b0c00640 1 -- start start 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac06e080 0x7f93ac14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac155550 0x7f93ac157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1515f0 con 0x7f93ac155180 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac14f800 con 0x7f93ac06e080 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.907+0000 7f93b0c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac14e760 con 0x7f93ac155550 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:54900/0 (socket says 172.21.15.110:54900) 2024-08-17T02:29:02.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 -- 172.21.15.110:0/2278677692 learned_addr learned my addr 172.21.15.110:0/2278677692 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93aa800640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac155550 0x7f93ac157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9e00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac06e080 0x7f93ac14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 -- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac155550 msgr2=0x7f93ac157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac155550 0x7f93ac157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 -- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac06e080 msgr2=0x7f93ac14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac06e080 0x7f93ac14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 -- 172.21.15.110:0/2278677692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009450 con 0x7f93ac155180 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a9400640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9398009210 tx=0x7f9398032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398031de0 con 0x7f93ac155180 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9398000c40 con 0x7f93ac155180 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.908+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac14ea40 con 0x7f93ac155180 2024-08-17T02:29:02.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.909+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939803d670 con 0x7f93ac155180 2024-08-17T02:29:02.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.909+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac14f000 con 0x7f93ac155180 2024-08-17T02:29:02.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.910+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac064db0 con 0x7f93ac155180 2024-08-17T02:29:02.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.910+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f9398039040 con 0x7f93ac155180 2024-08-17T02:29:02.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.911+0000 7f93a1600640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 0x7f938c067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:02.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.912+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f93980a1cb0 con 0x7f93ac155180 2024-08-17T02:29:02.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.912+0000 7f93a9e00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 0x7f938c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:02.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.912+0000 7f93a9e00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 0x7f938c067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1586d0 tx=0x7f939c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:02.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:02.916+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9398070330 con 0x7f93ac155180 2024-08-17T02:29:03.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.125+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ac154620 con 0x7f93ac155180 2024-08-17T02:29:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.125+0000 7f93a1600640 1 -- 172.21.15.110:0/2278677692 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f9398037500 con 0x7f93ac155180 2024-08-17T02:29:03.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:03.126 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-08-17T02:29:03.126 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 2 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 msgr2=0x7f938c067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 0x7f938c067570 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93ac1586d0 tx=0x7f939c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 msgr2=0x7f93ac1510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9398009210 tx=0x7f9398032000 comp rx=0 tx=0).stop 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 shutdown_connections 2024-08-17T02:29:03.128 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f938c0650c0 0x7f938c067570 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac155550 0x7f93ac157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93ac155180 0x7f93ac1510b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 --2- 172.21.15.110:0/2278677692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac06e080 0x7f93ac14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.127+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 >> 172.21.15.110:0/2278677692 conn(0x7f93ac0cb9b0 msgr2=0x7f93ac06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.128+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 shutdown_connections 2024-08-17T02:29:03.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:03.128+0000 7f93b0c00640 1 -- 172.21.15.110:0/2278677692 wait complete. 2024-08-17T02:29:05.143 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:05.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.298+0000 7f51d6c00640 1 Processor -- start 2024-08-17T02:29:05.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.298+0000 7f51d6c00640 1 -- start start 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51d6c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51d0155a20 0x7f51d00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51d6c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51d0155df0 0x7f51d00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51d6c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51d0156670 con 0x7f51d006d7f0 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51d6c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d00b0350 con 0x7f51d0155a20 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51d6c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d006e5e0 con 0x7f51d0155df0 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51cfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51d0155a20 0x7f51d00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51cfe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51d0155a20 0x7f51d00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51676/0 (socket says 172.21.15.110:51676) 2024-08-17T02:29:05.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.299+0000 7f51cfe00640 1 -- 172.21.15.110:0/219617516 learned_addr learned my addr 172.21.15.110:0/219617516 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.300+0000 7f51cf400640 1 --2- 172.21.15.110:0/219617516 >> v2:172.21.15.177:3300/0 conn(0x7f51d0155df0 0x7f51d00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.300+0000 7f51cfe00640 1 -- 172.21.15.110:0/219617516 >> v2:172.21.15.177:3300/0 conn(0x7f51d0155df0 msgr2=0x7f51d00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.300+0000 7f51cfe00640 1 --2- 172.21.15.110:0/219617516 >> v2:172.21.15.177:3300/0 conn(0x7f51d0155df0 0x7f51d00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.300+0000 7f51cfe00640 1 -- 172.21.15.110:0/219617516 >> v1:172.21.15.177:6789/0 conn(0x7f51d006d7f0 legacy=0x7f51d00ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.300+0000 7f51cfe00640 1 -- 172.21.15.110:0/219617516 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d006e8c0 con 0x7f51d0155a20 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51cfe00640 1 --2- 172.21.15.110:0/219617516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d00adf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f51d006aa10 tx=0x7f51c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822dbcec88e7f2f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51cea00640 1 -- 172.21.15.110:0/219617516 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c002ae80 con 0x7f51d0155a20 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51cea00640 1 -- 172.21.15.110:0/219617516 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0032440 con 0x7f51d0155a20 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51cea00640 1 -- 172.21.15.110:0/219617516 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0032800 con 0x7f51d0155a20 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51d6c00640 1 -- 172.21.15.110:0/219617516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 msgr2=0x7f51d00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.301+0000 7f51d6c00640 1 --2- 172.21.15.110:0/219617516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d00adf10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f51d006aa10 tx=0x7f51c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 -- 172.21.15.110:0/219617516 shutdown_connections 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 --2- 172.21.15.110:0/219617516 >> v2:172.21.15.177:3300/0 conn(0x7f51d0155df0 0x7f51d00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 --2- 172.21.15.110:0/219617516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d00adf10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 -- 172.21.15.110:0/219617516 >> 172.21.15.110:0/219617516 conn(0x7f51d00cb9b0 msgr2=0x7f51d00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 -- 172.21.15.110:0/219617516 shutdown_connections 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.302+0000 7f51d6c00640 1 -- 172.21.15.110:0/219617516 wait complete. 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.303+0000 7f51d6c00640 1 Processor -- start 2024-08-17T02:29:05.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.303+0000 7f51d6c00640 1 -- start start 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d006d7f0 0x7f51d015f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0155df0 0x7f51d00aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00adde0 con 0x7f51d0155a20 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d00abf10 con 0x7f51d0155df0 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d015eda0 con 0x7f51d006d7f0 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51cf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51cf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51680/0 (socket says 172.21.15.110:51680) 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51cf400640 1 -- 172.21.15.110:0/3061543367 learned_addr learned my addr 172.21.15.110:0/3061543367 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.304+0000 7f51d4c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0155df0 0x7f51d00aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cfe00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d006d7f0 0x7f51d015f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 -- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d006d7f0 msgr2=0x7f51d015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d006d7f0 0x7f51d015f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 -- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0155df0 msgr2=0x7f51d00aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0155df0 0x7f51d00aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 -- 172.21.15.110:0/3061543367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009450 con 0x7f51d0155a20 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51cf400640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00d860 tx=0x7f51bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0096a0 con 0x7f51d0155a20 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc009800 con 0x7f51d0155a20 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc009bc0 con 0x7f51d0155a20 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.305+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d015e040 con 0x7f51d0155a20 2024-08-17T02:29:05.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.306+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d015dd10 con 0x7f51d0155a20 2024-08-17T02:29:05.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.307+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d00abd70 con 0x7f51d0155a20 2024-08-17T02:29:05.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.307+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f51bc014410 con 0x7f51d0155a20 2024-08-17T02:29:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.308+0000 7f51c7400640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 0x7f51b0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.308+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f51bc082710 con 0x7f51d0155a20 2024-08-17T02:29:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.309+0000 7f51cfe00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 0x7f51b0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.309+0000 7f51cfe00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 0x7f51b0067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51c0034000 tx=0x7f51c0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.313+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51d00abd70 con 0x7f51d0155a20 2024-08-17T02:29:05.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.521+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51d00abd70 con 0x7f51d0155a20 2024-08-17T02:29:05.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.522+0000 7f51c7400640 1 -- 172.21.15.110:0/3061543367 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3533 (secure 0 0 0) 0x7f51d00abd70 con 0x7f51d0155a20 2024-08-17T02:29:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:05.523 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:29:05.523 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 3 2024-08-17T02:29:05.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 msgr2=0x7f51b0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 0x7f51b0067570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f51c0034000 tx=0x7f51c0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 msgr2=0x7f51d0152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00d860 tx=0x7f51bc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 shutdown_connections 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51b00650c0 0x7f51b0067570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0155df0 0x7f51d00aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0155a20 0x7f51d0152af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 --2- 172.21.15.110:0/3061543367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51d006d7f0 0x7f51d015f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 >> 172.21.15.110:0/3061543367 conn(0x7f51d00cb9b0 msgr2=0x7f51d00cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 shutdown_connections 2024-08-17T02:29:05.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.524+0000 7f51d6c00640 1 -- 172.21.15.110:0/3061543367 wait complete. 2024-08-17T02:29:05.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:05.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.685+0000 7fade1400640 1 Processor -- start 2024-08-17T02:29:05.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.685+0000 7fade1400640 1 -- start start 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.686+0000 7fade1400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 0x7faddc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.686+0000 7fade1400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 0x7faddc0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.686+0000 7fade1400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faddc0afc10 con 0x7faddc06e080 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.686+0000 7fade1400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faddc0ae5b0 con 0x7faddc155550 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fade1400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0af000 con 0x7faddc155180 2024-08-17T02:29:05.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7faddb200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faddc06e080 0x7faddc06e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56372/0 (socket says 172.21.15.110:56372) 2024-08-17T02:29:05.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7faddb200640 1 -- 172.21.15.110:0/469005210 learned_addr learned my addr 172.21.15.110:0/469005210 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:05.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadd1e00640 1 --2- 172.21.15.110:0/469005210 >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 0x7faddc0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadda800640 1 --2- 172.21.15.110:0/469005210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 0x7faddc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadd9e00640 1 -- 172.21.15.110:0/469005210 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195840255 0 0) 0x7faddc0afc10 con 0x7faddc06e080 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadd9e00640 1 -- 172.21.15.110:0/469005210 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadc00034e0 con 0x7faddc06e080 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadda800640 1 -- 172.21.15.110:0/469005210 >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 msgr2=0x7faddc0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadda800640 1 --2- 172.21.15.110:0/469005210 >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 0x7faddc0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadda800640 1 -- 172.21.15.110:0/469005210 >> v1:172.21.15.110:6789/0 conn(0x7faddc06e080 legacy=0x7faddc06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadda800640 1 -- 172.21.15.110:0/469005210 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc0af2e0 con 0x7faddc155180 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.687+0000 7fadd1e00640 1 --2- 172.21.15.110:0/469005210 >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 0x7faddc0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:05.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.688+0000 7fadda800640 1 --2- 172.21.15.110:0/469005210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 0x7faddc0aea20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009850 tx=0x7fadcc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=319e8d9f7a4e44cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.689+0000 7fadd9e00640 1 -- 172.21.15.110:0/469005210 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc02ad80 con 0x7faddc155180 2024-08-17T02:29:05.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.689+0000 7fadd9e00640 1 -- 172.21.15.110:0/469005210 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadcc032440 con 0x7faddc155180 2024-08-17T02:29:05.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.689+0000 7fadd9e00640 1 -- 172.21.15.110:0/469005210 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc032820 con 0x7faddc155180 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 -- 172.21.15.110:0/469005210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 msgr2=0x7faddc0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 --2- 172.21.15.110:0/469005210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 0x7faddc0aea20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009850 tx=0x7fadcc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 -- 172.21.15.110:0/469005210 shutdown_connections 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 --2- 172.21.15.110:0/469005210 >> v2:172.21.15.177:3300/0 conn(0x7faddc155550 0x7faddc0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 --2- 172.21.15.110:0/469005210 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc155180 0x7faddc0aea20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 -- 172.21.15.110:0/469005210 >> 172.21.15.110:0/469005210 conn(0x7faddc0cb9b0 msgr2=0x7faddc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 -- 172.21.15.110:0/469005210 shutdown_connections 2024-08-17T02:29:05.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.690+0000 7fade1400640 1 -- 172.21.15.110:0/469005210 wait complete. 2024-08-17T02:29:05.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.691+0000 7fade1400640 1 Processor -- start 2024-08-17T02:29:05.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.691+0000 7fade1400640 1 -- start start 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc06e080 0x7faddc0aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faddc155180 0x7faddc0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0ac0f0 con 0x7faddc155550 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0aa830 con 0x7faddc155180 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7fade1400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0ab040 con 0x7faddc06e080 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.692+0000 7faddb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51688/0 (socket says 172.21.15.110:51688) 2024-08-17T02:29:05.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 -- 172.21.15.110:0/1077050413 learned_addr learned my addr 172.21.15.110:0/1077050413 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fadda800640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc06e080 0x7faddc0aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fadd1e00640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faddc155180 0x7faddc0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 -- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc06e080 msgr2=0x7faddc0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc06e080 0x7faddc0aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 -- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faddc155180 msgr2=0x7faddc0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faddc155180 0x7faddc0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 -- 172.21.15.110:0/1077050413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc4009390 con 0x7faddc155550 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7faddb200640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadd400cc60 tx=0x7fadd4001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400ce80 con 0x7faddc155550 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400a850 con 0x7faddc155550 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400ac10 con 0x7faddc155550 2024-08-17T02:29:05.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.693+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc009390 con 0x7faddc155550 2024-08-17T02:29:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.694+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc0ab8e0 con 0x7faddc155550 2024-08-17T02:29:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.694+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc0ab470 con 0x7faddc155550 2024-08-17T02:29:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.695+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fadd4007300 con 0x7faddc155550 2024-08-17T02:29:05.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.696+0000 7fadd2a00640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 0x7fadb8067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.696+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fadd4082100 con 0x7faddc155550 2024-08-17T02:29:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.696+0000 7fadda800640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 0x7fadb8067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:05.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.697+0000 7fadda800640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 0x7fadb8067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadcc034000 tx=0x7fadcc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:05.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.700+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fadd4050630 con 0x7faddc155550 2024-08-17T02:29:05.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.876+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faddc064db0 con 0x7faddc155550 2024-08-17T02:29:05.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.877+0000 7fadd2a00640 1 -- 172.21.15.110:0/1077050413 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12188 (secure 0 0 0) 0x7fadd4053c50 con 0x7faddc155550 2024-08-17T02:29:05.877 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:05.877 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:05.120058+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:05.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 msgr2=0x7fadb8067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 0x7fadb8067570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadcc034000 tx=0x7fadcc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 msgr2=0x7faddc0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fadd400cc60 tx=0x7fadd4001aa0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 shutdown_connections 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadb80650c0 0x7fadb8067570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faddc155550 0x7faddc0c9710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faddc155180 0x7faddc0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 --2- 172.21.15.110:0/1077050413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faddc06e080 0x7faddc0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 >> 172.21.15.110:0/1077050413 conn(0x7faddc0cb9b0 msgr2=0x7faddc0c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 shutdown_connections 2024-08-17T02:29:05.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:05.879+0000 7fade1400640 1 -- 172.21.15.110:0/1077050413 wait complete. 2024-08-17T02:29:05.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:29:05.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:06.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.044+0000 7f67e0e00640 1 Processor -- start 2024-08-17T02:29:06.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.045+0000 7f67e0e00640 1 -- start start 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc064320 0x7f67dc06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f67dc06dee0 0x7f67dc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67dc0b0010 0x7f67dc0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc06e870 con 0x7f67dc0b0010 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0aef70 con 0x7f67dc06dee0 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67e0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0af250 con 0x7f67dc064320 2024-08-17T02:29:06.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67dc0b0010 0x7f67dc0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67dc0b0010 0x7f67dc0b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51704/0 (socket says 172.21.15.110:51704) 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 -- 172.21.15.110:0/1244194415 learned_addr learned my addr 172.21.15.110:0/1244194415 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67db400640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc064320 0x7f67dc06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67d2a00640 1 --2- 172.21.15.110:0/1244194415 >> v2:172.21.15.177:3300/0 conn(0x7f67dc06dee0 0x7f67dc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 -- 172.21.15.110:0/1244194415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc064320 msgr2=0x7f67dc06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc064320 0x7f67dc06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 -- 172.21.15.110:0/1244194415 >> v2:172.21.15.177:3300/0 conn(0x7f67dc06dee0 msgr2=0x7f67dc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 --2- 172.21.15.110:0/1244194415 >> v2:172.21.15.177:3300/0 conn(0x7f67dc06dee0 0x7f67dc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.048 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.046+0000 7f67dbe00640 1 -- 172.21.15.110:0/1244194415 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0af530 con 0x7f67dc0b0010 2024-08-17T02:29:06.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.047+0000 7f67dbe00640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc0b0420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67dc04bd80 tx=0x7f67d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa318897ab3b16b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67daa00640 1 -- 172.21.15.110:0/1244194415 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4031400 con 0x7f67dc0b0010 2024-08-17T02:29:06.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67daa00640 1 -- 172.21.15.110:0/1244194415 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d402d050 con 0x7f67dc0b0010 2024-08-17T02:29:06.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67daa00640 1 -- 172.21.15.110:0/1244194415 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40317d0 con 0x7f67dc0b0010 2024-08-17T02:29:06.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 -- 172.21.15.110:0/1244194415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 msgr2=0x7f67dc0b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc0b0420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67dc04bd80 tx=0x7f67d4009840 comp rx=0 tx=0).stop 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 -- 172.21.15.110:0/1244194415 shutdown_connections 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc0b0420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 --2- 172.21.15.110:0/1244194415 >> v2:172.21.15.177:3300/0 conn(0x7f67dc06dee0 0x7f67dc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 --2- 172.21.15.110:0/1244194415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc064320 0x7f67dc06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 -- 172.21.15.110:0/1244194415 >> 172.21.15.110:0/1244194415 conn(0x7f67dc067750 msgr2=0x7f67dc0cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 -- 172.21.15.110:0/1244194415 shutdown_connections 2024-08-17T02:29:06.050 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.048+0000 7f67e0e00640 1 -- 172.21.15.110:0/1244194415 wait complete. 2024-08-17T02:29:06.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.050+0000 7f67e0e00640 1 Processor -- start 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.050+0000 7f67e0e00640 1 -- start start 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67dc064320 0x7f67dc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc06dee0 0x7f67dc1573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc14dad0 con 0x7f67dc0b0010 2024-08-17T02:29:06.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc14ddb0 con 0x7f67dc064320 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67e0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc14e090 con 0x7f67dc06dee0 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51716/0 (socket says 172.21.15.110:51716) 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 -- 172.21.15.110:0/2664729518 learned_addr learned my addr 172.21.15.110:0/2664729518 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67d2a00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc06dee0 0x7f67dc1573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67db400640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67dc064320 0x7f67dc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 -- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc06dee0 msgr2=0x7f67dc1573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc06dee0 0x7f67dc1573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 -- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67dc064320 msgr2=0x7f67dc155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67dc064320 0x7f67dc155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.051+0000 7f67dbe00640 1 -- 172.21.15.110:0/2664729518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4009ae0 con 0x7f67dc0b0010 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67dbe00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009f50 tx=0x7f67d4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4007170 con 0x7f67dc0b0010 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4008e50 con 0x7f67dc0b0010 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d403b680 con 0x7f67dc0b0010 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc14e370 con 0x7f67dc0b0010 2024-08-17T02:29:06.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.052+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc1564b0 con 0x7f67dc0b0010 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.053+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc071050 con 0x7f67dc0b0010 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.054+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f67d4038050 con 0x7f67dc0b0010 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.055+0000 7f67d3400640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 0x7f67b8067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.055+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f67d40a2e20 con 0x7f67dc0b0010 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.055+0000 7f67db400640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 0x7f67b8067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.055+0000 7f67db400640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 0x7f67b8067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00bb70 tx=0x7f67cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.059+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f67d4071270 con 0x7f67dc0b0010 2024-08-17T02:29:06.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.257+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67dc0691b0 con 0x7f67dc0b0010 2024-08-17T02:29:06.257 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.257+0000 7f67d3400640 1 -- 172.21.15.110:0/2664729518 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67d4049020 con 0x7f67dc0b0010 2024-08-17T02:29:06.258 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 msgr2=0x7f67b8067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 0x7f67b8067570 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00bb70 tx=0x7f67cc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 msgr2=0x7f67dc148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009f50 tx=0x7f67d4036000 comp rx=0 tx=0).stop 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 shutdown_connections 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f67b80650c0 0x7f67b8067570 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc0b0010 0x7f67dc148ea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67dc06dee0 0x7f67dc1573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 --2- 172.21.15.110:0/2664729518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67dc064320 0x7f67dc155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 >> 172.21.15.110:0/2664729518 conn(0x7f67dc067750 msgr2=0x7f67dc150230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 shutdown_connections 2024-08-17T02:29:06.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.259+0000 7f67e0e00640 1 -- 172.21.15.110:0/2664729518 wait complete. 2024-08-17T02:29:06.274 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:29:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.429+0000 7fb595800640 1 Processor -- start 2024-08-17T02:29:06.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.429+0000 7fb595800640 1 -- start start 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb590159ca0 0x7fb5900ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ca8a0 0x7fb5900cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb5900ccad0 0x7fb5900cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900cd6e0 con 0x7fb590159ca0 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900ccf70 con 0x7fb5900ccad0 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb595800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900cadc0 con 0x7fb5900ca8a0 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb58fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb590159ca0 0x7fb5900ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb58fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb590159ca0 0x7fb5900ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51738/0 (socket says 172.21.15.110:51738) 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb58fe00640 1 -- 172.21.15.110:0/2769157442 learned_addr learned my addr 172.21.15.110:0/2769157442 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb594e00640 1 --2- 172.21.15.110:0/2769157442 >> v2:172.21.15.177:3300/0 conn(0x7fb5900ccad0 0x7fb5900cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.430+0000 7fb58f400640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ca8a0 0x7fb5900cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.431+0000 7fb58fe00640 1 -- 172.21.15.110:0/2769157442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ca8a0 msgr2=0x7fb5900cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.431+0000 7fb58fe00640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ca8a0 0x7fb5900cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.431+0000 7fb58fe00640 1 -- 172.21.15.110:0/2769157442 >> v2:172.21.15.177:3300/0 conn(0x7fb5900ccad0 msgr2=0x7fb5900cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.431+0000 7fb58fe00640 1 --2- 172.21.15.110:0/2769157442 >> v2:172.21.15.177:3300/0 conn(0x7fb5900ccad0 0x7fb5900cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.431+0000 7fb58fe00640 1 -- 172.21.15.110:0/2769157442 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5900cb060 con 0x7fb590159ca0 2024-08-17T02:29:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.432+0000 7fb58fe00640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb590159ca0 0x7fb5900ca360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b5c60 tx=0x7fb5800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4bcd5b4202a26f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.432+0000 7fb58ea00640 1 -- 172.21.15.110:0/2769157442 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58002add0 con 0x7fb590159ca0 2024-08-17T02:29:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.432+0000 7fb58ea00640 1 -- 172.21.15.110:0/2769157442 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb580032440 con 0x7fb590159ca0 2024-08-17T02:29:06.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.432+0000 7fb58ea00640 1 -- 172.21.15.110:0/2769157442 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580032820 con 0x7fb590159ca0 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 -- 172.21.15.110:0/2769157442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb590159ca0 msgr2=0x7fb5900ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb590159ca0 0x7fb5900ca360 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5900b5c60 tx=0x7fb5800091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 -- 172.21.15.110:0/2769157442 shutdown_connections 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 --2- 172.21.15.110:0/2769157442 >> v2:172.21.15.177:3300/0 conn(0x7fb5900ccad0 0x7fb5900cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ca8a0 0x7fb5900cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 --2- 172.21.15.110:0/2769157442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb590159ca0 0x7fb5900ca360 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 -- 172.21.15.110:0/2769157442 >> 172.21.15.110:0/2769157442 conn(0x7fb590098e00 msgr2=0x7fb59006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 -- 172.21.15.110:0/2769157442 shutdown_connections 2024-08-17T02:29:06.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.433+0000 7fb595800640 1 -- 172.21.15.110:0/2769157442 wait complete. 2024-08-17T02:29:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.435+0000 7fb595800640 1 Processor -- start 2024-08-17T02:29:06.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.435+0000 7fb595800640 1 -- start start 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5900ca8a0 0x7fb590169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb590159ca0 0x7fb590099770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590169e70 con 0x7fb5900ca8a0 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb590155970 con 0x7fb590159ca0 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb595800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900c46f0 con 0x7fb5900ccad0 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:50750/0 (socket says 172.21.15.110:50750) 2024-08-17T02:29:06.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 -- 172.21.15.110:0/3993300593 learned_addr learned my addr 172.21.15.110:0/3993300593 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5900ca8a0 0x7fb590169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb594e00640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb590159ca0 0x7fb590099770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 -- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb590159ca0 msgr2=0x7fb590099770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb590159ca0 0x7fb590099770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 -- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5900ca8a0 msgr2=0x7fb590169930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5900ca8a0 0x7fb590169930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.436+0000 7fb58f400640 1 -- 172.21.15.110:0/3993300593 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580009450 con 0x7fb5900ccad0 2024-08-17T02:29:06.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.437+0000 7fb58f400640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ea50 tx=0x7fb57c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.439+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c00ca10 con 0x7fb5900ccad0 2024-08-17T02:29:06.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.439+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c00cb70 con 0x7fb5900ccad0 2024-08-17T02:29:06.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.439+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c013470 con 0x7fb5900ccad0 2024-08-17T02:29:06.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.439+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59009c150 con 0x7fb5900ccad0 2024-08-17T02:29:06.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.439+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59009c9f0 con 0x7fb5900ccad0 2024-08-17T02:29:06.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.441+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59009c550 con 0x7fb5900ccad0 2024-08-17T02:29:06.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.441+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7fb57c013860 con 0x7fb5900ccad0 2024-08-17T02:29:06.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.442+0000 7fb587400640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 0x7fb570067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.442+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb57c082430 con 0x7fb5900ccad0 2024-08-17T02:29:06.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.447+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb57c0509f0 con 0x7fb5900ccad0 2024-08-17T02:29:06.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.455+0000 7fb58fe00640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 0x7fb570067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.455+0000 7fb58fe00640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 0x7fb570067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb580034000 tx=0x7fb580032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.635+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb590071050 con 0x7fb5900ccad0 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.636+0000 7fb587400640 1 -- 172.21.15.110:0/3993300593 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb57c054010 con 0x7fb5900ccad0 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": ".mgr" 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-08-17T02:29:06.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 msgr2=0x7fb570067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 0x7fb570067570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb580034000 tx=0x7fb580032000 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 msgr2=0x7fb59009b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb57c00ea50 tx=0x7fb57c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 shutdown_connections 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb5700650c0 0x7fb570067570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb590159ca0 0x7fb590099770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5900ccad0 0x7fb59009b6b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 --2- 172.21.15.110:0/3993300593 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5900ca8a0 0x7fb590169930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 >> 172.21.15.110:0/3993300593 conn(0x7fb590098e00 msgr2=0x7fb5900673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 shutdown_connections 2024-08-17T02:29:06.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.638+0000 7fb595800640 1 -- 172.21.15.110:0/3993300593 wait complete. 2024-08-17T02:29:06.656 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:29:06.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:29:06.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.811+0000 7f09ef200640 1 Processor -- start 2024-08-17T02:29:06.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.811+0000 7f09ef200640 1 -- start start 2024-08-17T02:29:06.812 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ef200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f09f0158e50 0x7f09f00cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ef200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09f00cc700 0x7f09f00ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ef200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00ceeb0 con 0x7f09f00ce5c0 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ef200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00cf190 con 0x7f09f00cc700 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ef200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00cf470 con 0x7f09f0158e50 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ed400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09f00cc700 0x7f09f00ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ed400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09f00cc700 0x7f09f00ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51760/0 (socket says 172.21.15.110:51760) 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ee800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f09f00ce5c0 0x7f09f00ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56376/0 (socket says 172.21.15.110:56376) 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ede00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f09f0158e50 0x7f09f00cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.812+0000 7f09ed400640 1 -- 172.21.15.110:0/2488098638 learned_addr learned my addr 172.21.15.110:0/2488098638 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.813+0000 7f09ed400640 1 -- 172.21.15.110:0/2488098638 >> v2:172.21.15.177:3300/0 conn(0x7f09f0158e50 msgr2=0x7f09f00cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.813+0000 7f09ed400640 1 --2- 172.21.15.110:0/2488098638 >> v2:172.21.15.177:3300/0 conn(0x7f09f0158e50 0x7f09f00cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.813+0000 7f09ed400640 1 -- 172.21.15.110:0/2488098638 >> v1:172.21.15.110:6789/0 conn(0x7f09f00ce5c0 legacy=0x7f09f00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.813+0000 7f09eca00640 1 -- 172.21.15.110:0/2488098638 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802831433 0 0) 0x7f09f00ceeb0 con 0x7f09f00ce5c0 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.813+0000 7f09ed400640 1 -- 172.21.15.110:0/2488098638 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00b2a00 con 0x7f09f00cc700 2024-08-17T02:29:06.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.814+0000 7f09ed400640 1 --2- 172.21.15.110:0/2488098638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f00cc700 0x7f09f00ce080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f09f00664e0 tx=0x7f09dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909c17292cfb0cba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.814+0000 7f09eca00640 1 -- 172.21.15.110:0/2488098638 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc02ae80 con 0x7f09f00cc700 2024-08-17T02:29:06.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.814+0000 7f09eca00640 1 -- 172.21.15.110:0/2488098638 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc032440 con 0x7f09f00cc700 2024-08-17T02:29:06.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.814+0000 7f09eca00640 1 -- 172.21.15.110:0/2488098638 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0327c0 con 0x7f09f00cc700 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 -- 172.21.15.110:0/2488098638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f00cc700 msgr2=0x7f09f00ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 --2- 172.21.15.110:0/2488098638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f00cc700 0x7f09f00ce080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f09f00664e0 tx=0x7f09dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 -- 172.21.15.110:0/2488098638 shutdown_connections 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 --2- 172.21.15.110:0/2488098638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f00cc700 0x7f09f00ce080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 --2- 172.21.15.110:0/2488098638 >> v2:172.21.15.177:3300/0 conn(0x7f09f0158e50 0x7f09f00cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 -- 172.21.15.110:0/2488098638 >> 172.21.15.110:0/2488098638 conn(0x7f09f0098de0 msgr2=0x7f09f006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 -- 172.21.15.110:0/2488098638 shutdown_connections 2024-08-17T02:29:06.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.815+0000 7f09ef200640 1 -- 172.21.15.110:0/2488098638 wait complete. 2024-08-17T02:29:06.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.817+0000 7f09ef200640 1 Processor -- start 2024-08-17T02:29:06.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.817+0000 7f09ef200640 1 -- start start 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09f00cc700 0x7f09f015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09f00ce5c0 0x7f09f01579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015b770 con 0x7f09f0158e50 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015aaf0 con 0x7f09f00ce5c0 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ef200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f015add0 con 0x7f09f00cc700 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ee800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51764/0 (socket says 172.21.15.110:51764) 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ee800640 1 -- 172.21.15.110:0/2979336779 learned_addr learned my addr 172.21.15.110:0/2979336779 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.818+0000 7f09ed400640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09f00ce5c0 0x7f09f01579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ede00640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09f00cc700 0x7f09f015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 -- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09f00cc700 msgr2=0x7f09f015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09f00cc700 0x7f09f015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 -- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09f00ce5c0 msgr2=0x7f09f01579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09f00ce5c0 0x7f09f01579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 -- 172.21.15.110:0/2979336779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009450 con 0x7f09f0158e50 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ee800640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c870 tx=0x7f09e8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800ce60 con 0x7f09f0158e50 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8005d60 con 0x7f09f0158e50 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800a870 con 0x7f09f0158e50 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f015b0b0 con 0x7f09f0158e50 2024-08-17T02:29:06.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.819+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f015a730 con 0x7f09f0158e50 2024-08-17T02:29:06.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.821+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0071050 con 0x7f09f0158e50 2024-08-17T02:29:06.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.821+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f09e800aca0 con 0x7f09f0158e50 2024-08-17T02:29:06.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.822+0000 7f09e5600640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 0x7f09d0067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:06.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.822+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f09e8081bf0 con 0x7f09f0158e50 2024-08-17T02:29:06.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.822+0000 7f09ede00640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 0x7f09d0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:06.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.823+0000 7f09ede00640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 0x7f09d0067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009c80 tx=0x7f09e00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:06.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:06.827+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f09e8050170 con 0x7f09f0158e50 2024-08-17T02:29:07.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.007+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f09f015b8b0 con 0x7f09f0158e50 2024-08-17T02:29:07.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.441+0000 7f09e5600640 1 -- 172.21.15.110:0/2979336779 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f09f015b8b0 con 0x7f09f0158e50 2024-08-17T02:29:07.441 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2024-08-17T02:29:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.444+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 msgr2=0x7f09d0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.444+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 0x7f09d0067570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009c80 tx=0x7f09e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.444+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 msgr2=0x7f09f0146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.444+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c870 tx=0x7f09e8001630 comp rx=0 tx=0).stop 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 shutdown_connections 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f09d00650c0 0x7f09d0067570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09f0158e50 0x7f09f0146c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09f00ce5c0 0x7f09f01579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 --2- 172.21.15.110:0/2979336779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09f00cc700 0x7f09f015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 >> 172.21.15.110:0/2979336779 conn(0x7f09f0098de0 msgr2=0x7f09f00b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 shutdown_connections 2024-08-17T02:29:07.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.445+0000 7f09ef200640 1 -- 172.21.15.110:0/2979336779 wait complete. 2024-08-17T02:29:07.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:29:07.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.621+0000 7f1885800640 1 Processor -- start 2024-08-17T02:29:07.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.621+0000 7f1885800640 1 -- start start 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f1885800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f18800b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f1885800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1880159ae0 0x7f18800aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f1885800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18800ae020 con 0x7f18800b0b30 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f1885800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18800b1ba0 con 0x7f1880159ae0 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f1885800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b2c70 con 0x7f18800b5930 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187ea00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f18800b0b30 0x7f18800ae4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:38384/0 (socket says 172.21.15.110:38384) 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f18800b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187ea00640 1 -- 172.21.15.110:0/3826375831 learned_addr learned my addr 172.21.15.110:0/3826375831 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187f400640 1 --2- 172.21.15.110:0/3826375831 >> v2:172.21.15.110:3300/0 conn(0x7f1880159ae0 0x7f18800aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187d600640 1 -- 172.21.15.110:0/3826375831 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540033383 0 0) 0x7f18800ae020 con 0x7f18800b0b30 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187e000640 1 -- 172.21.15.110:0/3826375831 >> v2:172.21.15.110:3300/0 conn(0x7f1880159ae0 msgr2=0x7f18800aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187e000640 1 --2- 172.21.15.110:0/3826375831 >> v2:172.21.15.110:3300/0 conn(0x7f1880159ae0 0x7f18800aebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.623+0000 7f187e000640 1 -- 172.21.15.110:0/3826375831 >> v1:172.21.15.177:6789/0 conn(0x7f18800b0b30 legacy=0x7f18800ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.624+0000 7f187e000640 1 -- 172.21.15.110:0/3826375831 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800b0040 con 0x7f18800b5930 2024-08-17T02:29:07.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.625+0000 7f187e000640 1 --2- 172.21.15.110:0/3826375831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f18800b0f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e43328972492bcdc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.625+0000 7f187d600640 1 -- 172.21.15.110:0/3826375831 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c02ad90 con 0x7f18800b5930 2024-08-17T02:29:07.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.625+0000 7f187d600640 1 -- 172.21.15.110:0/3826375831 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c032440 con 0x7f18800b5930 2024-08-17T02:29:07.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.625+0000 7f187d600640 1 -- 172.21.15.110:0/3826375831 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c0327e0 con 0x7f18800b5930 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 -- 172.21.15.110:0/3826375831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 msgr2=0x7f18800b0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 --2- 172.21.15.110:0/3826375831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f18800b0f00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f186c009850 tx=0x7f186c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 -- 172.21.15.110:0/3826375831 shutdown_connections 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 --2- 172.21.15.110:0/3826375831 >> v2:172.21.15.110:3300/0 conn(0x7f1880159ae0 0x7f18800aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 --2- 172.21.15.110:0/3826375831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f18800b0f00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 -- 172.21.15.110:0/3826375831 >> 172.21.15.110:0/3826375831 conn(0x7f18800cfdb0 msgr2=0x7f18800d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 -- 172.21.15.110:0/3826375831 shutdown_connections 2024-08-17T02:29:07.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.626+0000 7f1885800640 1 -- 172.21.15.110:0/3826375831 wait complete. 2024-08-17T02:29:07.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.627+0000 7f1885800640 1 Processor -- start 2024-08-17T02:29:07.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.627+0000 7f1885800640 1 -- start start 2024-08-17T02:29:07.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 0x7f1880154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f1880169c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 0x7f1880067510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18801545b0 con 0x7f1880159ae0 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c4bf0 con 0x7f18800b0b30 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.628+0000 7f1885800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800c4ed0 con 0x7f18800b5930 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 0x7f1880067510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 0x7f1880067510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51796/0 (socket says 172.21.15.110:51796) 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187f400640 1 -- 172.21.15.110:0/1287677851 learned_addr learned my addr 172.21.15.110:0/1287677851 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187e000640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f1880169c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 0x7f1880154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 -- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 msgr2=0x7f1880169c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f1880169c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 -- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 msgr2=0x7f1880067510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 0x7f1880067510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187ea00640 1 -- 172.21.15.110:0/1287677851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c009390 con 0x7f18800b0b30 2024-08-17T02:29:07.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.629+0000 7f187e000640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f1880169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f187ea00640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 0x7f1880154070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f187000c500 tx=0x7f1870007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870005aa0 con 0x7f18800b0b30 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870005c00 con 0x7f18800b0b30 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800c51b0 con 0x7f18800b0b30 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700070d0 con 0x7f18800b0b30 2024-08-17T02:29:07.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.630+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18800c5770 con 0x7f18800b0b30 2024-08-17T02:29:07.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.631+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800c5960 con 0x7f18800b0b30 2024-08-17T02:29:07.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.632+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f1870007500 con 0x7f18800b0b30 2024-08-17T02:29:07.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.633+0000 7f1876000640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 0x7f1860067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.633+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1870081650 con 0x7f18800b0b30 2024-08-17T02:29:07.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.633+0000 7f187e000640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 0x7f1860067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.633+0000 7f187e000640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 0x7f1860067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f186c034000 tx=0x7f186c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.637+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f187004faa0 con 0x7f18800b0b30 2024-08-17T02:29:07.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:07.817+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18800710c0 con 0x7f18800b0b30 2024-08-17T02:29:08.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.145+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f187004fe70 con 0x7f18800b0b30 2024-08-17T02:29:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.449+0000 7f1876000640 1 -- 172.21.15.110:0/1287677851 <== mon.1 v2:172.21.15.177:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f187007dc10 con 0x7f18800b0b30 2024-08-17T02:29:08.450 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2024-08-17T02:29:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.454+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 msgr2=0x7f1860067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.454+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 0x7f1860067570 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f186c034000 tx=0x7f186c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.454+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 msgr2=0x7f1880154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.454+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 0x7f1880154070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f187000c500 tx=0x7f1870007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 shutdown_connections 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f18600650c0 0x7f1860067570 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1880159ae0 0x7f1880067510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18800b5930 0x7f1880169c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 --2- 172.21.15.110:0/1287677851 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18800b0b30 0x7f1880154070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.456+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 >> 172.21.15.110:0/1287677851 conn(0x7f18800cfdb0 msgr2=0x7f18801593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.457+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 shutdown_connections 2024-08-17T02:29:08.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.457+0000 7f1885800640 1 -- 172.21.15.110:0/1287677851 wait complete. 2024-08-17T02:29:08.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:29:08.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.634+0000 7f88b7e00640 1 Processor -- start 2024-08-17T02:29:08.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.635+0000 7f88b7e00640 1 -- start start 2024-08-17T02:29:08.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 0x7f88b80c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b7e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80afc40 con 0x7f88b80adfb0 2024-08-17T02:29:08.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b7e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80af030 con 0x7f88b8155a30 2024-08-17T02:29:08.637 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80af310 con 0x7f88b8155660 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88ae000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f88b80adfb0 0x7f88b80ae750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56382/0 (socket says 172.21.15.110:56382) 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88ae000640 1 -- 172.21.15.110:0/749045619 learned_addr learned my addr 172.21.15.110:0/749045619 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b6a00640 1 --2- 172.21.15.110:0/749045619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 0x7f88b80c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828383538 0 0) 0x7f88b80afc40 con 0x7f88b80adfb0 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.636+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f889c0034e0 con 0x7f88b80adfb0 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.637+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749808349 0 0) 0x7f88b80af030 con 0x7f88b8155a30 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.637+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b80afc40 con 0x7f88b8155a30 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.637+0000 7f88b6a00640 1 -- 172.21.15.110:0/749045619 >> v1:172.21.15.177:6789/0 conn(0x7f88b8155a30 legacy=0x7f88b806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.637+0000 7f88b6a00640 1 -- 172.21.15.110:0/749045619 >> v1:172.21.15.110:6789/0 conn(0x7f88b80adfb0 legacy=0x7f88b80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.637+0000 7f88b6a00640 1 -- 172.21.15.110:0/749045619 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80af5f0 con 0x7f88b8155660 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b6a00640 1 --2- 172.21.15.110:0/749045619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 0x7f88b80c7fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009880 tx=0x7f88a80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a02073f064b804d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a802ae10 con 0x7f88b8155660 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8032440 con 0x7f88b8155660 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b6000640 1 -- 172.21.15.110:0/749045619 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80327e0 con 0x7f88b8155660 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b7e00640 1 -- 172.21.15.110:0/749045619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 msgr2=0x7f88b80c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.638+0000 7f88b7e00640 1 --2- 172.21.15.110:0/749045619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 0x7f88b80c7fe0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009880 tx=0x7f88a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.639+0000 7f88b7e00640 1 -- 172.21.15.110:0/749045619 shutdown_connections 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.639+0000 7f88b7e00640 1 --2- 172.21.15.110:0/749045619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155660 0x7f88b80c7fe0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.639+0000 7f88b7e00640 1 -- 172.21.15.110:0/749045619 >> 172.21.15.110:0/749045619 conn(0x7f88b8066cd0 msgr2=0x7f88b80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.639+0000 7f88b7e00640 1 -- 172.21.15.110:0/749045619 shutdown_connections 2024-08-17T02:29:08.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.639+0000 7f88b7e00640 1 -- 172.21.15.110:0/749045619 wait complete. 2024-08-17T02:29:08.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.640+0000 7f88b7e00640 1 Processor -- start 2024-08-17T02:29:08.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.640+0000 7f88b7e00640 1 -- start start 2024-08-17T02:29:08.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b80adfb0 0x7f88b8157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155a30 0x7f88b81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8169e40 con 0x7f88b8155660 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8156480 con 0x7f88b80adfb0 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b8156760 con 0x7f88b8155a30 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88ae000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88ae000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51812/0 (socket says 172.21.15.110:51812) 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88ae000640 1 -- 172.21.15.110:0/1133157942 learned_addr learned my addr 172.21.15.110:0/1133157942 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b6a00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b80adfb0 0x7f88b8157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.641+0000 7f88b7400640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155a30 0x7f88b81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 -- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155a30 msgr2=0x7f88b81521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155a30 0x7f88b81521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 -- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b80adfb0 msgr2=0x7f88b8157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b80adfb0 0x7f88b8157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 -- 172.21.15.110:0/1133157942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009390 con 0x7f88b8155660 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88ae000640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005840 tx=0x7f88a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0005aa0 con 0x7f88b8155660 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0005c00 con 0x7f88b8155660 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00070f0 con 0x7f88b8155660 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b8156a40 con 0x7f88b8155660 2024-08-17T02:29:08.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.642+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b8157000 con 0x7f88b8155660 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.643+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b8157220 con 0x7f88b8155660 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.644+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88a0007520 con 0x7f88b8155660 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.645+0000 7f88aea00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 0x7f8894067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.645+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f88a0081d40 con 0x7f88b8155660 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.645+0000 7f88b6a00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 0x7f8894067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.646+0000 7f88b6a00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 0x7f8894067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88a8034000 tx=0x7f88a8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.650+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88a004ff90 con 0x7f88b8155660 2024-08-17T02:29:08.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:08.856+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f88b8071050 con 0x7f88b8155660 2024-08-17T02:29:09.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.468+0000 7f88aea00640 1 -- 172.21.15.110:0/1133157942 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f88a00535b0 con 0x7f88b8155660 2024-08-17T02:29:09.472 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:29:09.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 msgr2=0x7f8894067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 0x7f8894067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88a8034000 tx=0x7f88a8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 msgr2=0x7f88b8169900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88a0005840 tx=0x7f88a0007e10 comp rx=0 tx=0).stop 2024-08-17T02:29:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 shutdown_connections 2024-08-17T02:29:09.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8894065150 0x7f8894067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88b8155a30 0x7f88b81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8155660 0x7f88b8169900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 --2- 172.21.15.110:0/1133157942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88b80adfb0 0x7f88b8157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.477+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 >> 172.21.15.110:0/1133157942 conn(0x7f88b8066cd0 msgr2=0x7f88b80aa230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.478+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 shutdown_connections 2024-08-17T02:29:09.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.478+0000 7f88b7e00640 1 -- 172.21.15.110:0/1133157942 wait complete. 2024-08-17T02:29:09.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:09.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.655+0000 7f328aa00640 1 Processor -- start 2024-08-17T02:29:09.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.655+0000 7f328aa00640 1 -- start start 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.656+0000 7f328aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32841401b0 0x7f32840caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.656+0000 7f328aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32840b1440 0x7f32840c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.656+0000 7f328aa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840caa80 con 0x7f3284140580 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f328aa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840cb450 con 0x7f32840b1440 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f328aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840c9e70 con 0x7f32841401b0 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32840b1440 0x7f32840c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32840b1440 0x7f32840c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51824/0 (socket says 172.21.15.110:51824) 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 -- 172.21.15.110:0/568158360 learned_addr learned my addr 172.21.15.110:0/568158360 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:09.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3283e00640 1 --2- 172.21.15.110:0/568158360 >> v2:172.21.15.177:3300/0 conn(0x7f32841401b0 0x7f32840caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 -- 172.21.15.110:0/568158360 >> v2:172.21.15.177:3300/0 conn(0x7f32841401b0 msgr2=0x7f32840caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:09.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 --2- 172.21.15.110:0/568158360 >> v2:172.21.15.177:3300/0 conn(0x7f32841401b0 0x7f32840caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 -- 172.21.15.110:0/568158360 >> v1:172.21.15.177:6789/0 conn(0x7f3284140580 legacy=0x7f32840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.657+0000 7f3288a00640 1 -- 172.21.15.110:0/568158360 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840ca150 con 0x7f32840b1440 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.658+0000 7f3288a00640 1 --2- 172.21.15.110:0/568158360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32840b1440 0x7f32840c9040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3284068650 tx=0x7f327c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421411c65ee6bf9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.658+0000 7f3282a00640 1 -- 172.21.15.110:0/568158360 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c031400 con 0x7f32840b1440 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.658+0000 7f3282a00640 1 -- 172.21.15.110:0/568158360 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c02d050 con 0x7f32840b1440 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f3282a00640 1 -- 172.21.15.110:0/568158360 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0317d0 con 0x7f32840b1440 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 -- 172.21.15.110:0/568158360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32840b1440 msgr2=0x7f32840c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 --2- 172.21.15.110:0/568158360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32840b1440 0x7f32840c9040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3284068650 tx=0x7f327c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 -- 172.21.15.110:0/568158360 shutdown_connections 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 --2- 172.21.15.110:0/568158360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32840b1440 0x7f32840c9040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 --2- 172.21.15.110:0/568158360 >> v2:172.21.15.177:3300/0 conn(0x7f32841401b0 0x7f32840caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 -- 172.21.15.110:0/568158360 >> 172.21.15.110:0/568158360 conn(0x7f32840cb9b0 msgr2=0x7f32840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 -- 172.21.15.110:0/568158360 shutdown_connections 2024-08-17T02:29:09.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.659+0000 7f328aa00640 1 -- 172.21.15.110:0/568158360 wait complete. 2024-08-17T02:29:09.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.660+0000 7f328aa00640 1 Processor -- start 2024-08-17T02:29:09.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.661+0000 7f328aa00640 1 -- start start 2024-08-17T02:29:09.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.661+0000 7f328aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 0x7f32840afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.661+0000 7f328aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f328aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 0x7f32840aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f328aa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840af940 con 0x7f32841401b0 2024-08-17T02:29:09.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f328aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840ad020 con 0x7f3284140580 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f328aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840ad300 con 0x7f32840b1440 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51828/0 (socket says 172.21.15.110:51828) 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 -- 172.21.15.110:0/3874692373 learned_addr learned my addr 172.21.15.110:0/3874692373 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283e00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 0x7f32840afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3288a00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 0x7f32840aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 -- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 msgr2=0x7f32840afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 0x7f32840afdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 -- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 msgr2=0x7f32840aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 0x7f32840aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 -- 172.21.15.110:0/3874692373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009ae0 con 0x7f32841401b0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3288a00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 0x7f32840aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283e00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 0x7f32840afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.662+0000 7f3283400640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f327000c560 tx=0x7f3270007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.663+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011590 con 0x7f32841401b0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.663+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270011710 con 0x7f32841401b0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.663+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270011ad0 con 0x7f32841401b0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.663+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840ad5e0 con 0x7f32841401b0 2024-08-17T02:29:09.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.663+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840b0310 con 0x7f32841401b0 2024-08-17T02:29:09.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.664+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32840afab0 con 0x7f32841401b0 2024-08-17T02:29:09.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.664+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f327001b3b0 con 0x7f32841401b0 2024-08-17T02:29:09.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.665+0000 7f327b400640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:09.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.665+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3270081a90 con 0x7f32841401b0 2024-08-17T02:29:09.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.666+0000 7f3283e00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:09.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.666+0000 7f3283e00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 0x7f3264067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32740099b0 tx=0x7f3274008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:09.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.670+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f327004fab0 con 0x7f32841401b0 2024-08-17T02:29:09.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.858+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3284064db0 con 0x7f32841401b0 2024-08-17T02:29:09.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.859+0000 7f327b400640 1 -- 172.21.15.110:0/3874692373 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f3270017070 con 0x7f32841401b0 2024-08-17T02:29:09.860 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:09.860 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:08.857620+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:09.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 msgr2=0x7f3264067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 0x7f3264067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32740099b0 tx=0x7f3274008040 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 msgr2=0x7f328413ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f327000c560 tx=0x7f3270007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 shutdown_connections 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3264065150 0x7f3264067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3284140580 0x7f32840aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32841401b0 0x7f328413ced0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 --2- 172.21.15.110:0/3874692373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32840b1440 0x7f32840afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 >> 172.21.15.110:0/3874692373 conn(0x7f32840cb9b0 msgr2=0x7f32840c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 shutdown_connections 2024-08-17T02:29:09.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:09.862+0000 7f328aa00640 1 -- 172.21.15.110:0/3874692373 wait complete. 2024-08-17T02:29:09.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:10.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.024+0000 7f1682e00640 1 Processor -- start 2024-08-17T02:29:10.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.024+0000 7f1682e00640 1 -- start start 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1682e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155a20 0x7f167c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1682e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f167c155df0 0x7f167c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1682e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c156670 con 0x7f167c06d7f0 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1682e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c0b0350 con 0x7f167c155df0 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1682e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c06e5e0 con 0x7f167c155a20 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f167c155df0 0x7f167c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f167c155df0 0x7f167c0ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51838/0 (socket says 172.21.15.110:51838) 2024-08-17T02:29:10.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 -- 172.21.15.110:0/4000861511 learned_addr learned my addr 172.21.15.110:0/4000861511 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f1680e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f167c06d7f0 0x7f167c0ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56394/0 (socket says 172.21.15.110:56394) 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167be00640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155a20 0x7f167c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 -- 172.21.15.110:0/4000861511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155a20 msgr2=0x7f167c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155a20 0x7f167c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 -- 172.21.15.110:0/4000861511 >> v1:172.21.15.110:6789/0 conn(0x7f167c06d7f0 legacy=0x7f167c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167b400640 1 -- 172.21.15.110:0/4000861511 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c06e8c0 con 0x7f167c155df0 2024-08-17T02:29:10.028 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.026+0000 7f167aa00640 1 -- 172.21.15.110:0/4000861511 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364076944 0 0) 0x7f167c156670 con 0x7f167c06d7f0 2024-08-17T02:29:10.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.027+0000 7f167b400640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c155df0 0x7f167c0ad9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1668009910 tx=0x7f16680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a36d24421a539f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f167aa00640 1 -- 172.21.15.110:0/4000861511 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166802ae40 con 0x7f167c155df0 2024-08-17T02:29:10.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f167aa00640 1 -- 172.21.15.110:0/4000861511 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668032440 con 0x7f167c155df0 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f167aa00640 1 -- 172.21.15.110:0/4000861511 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680327e0 con 0x7f167c155df0 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 -- 172.21.15.110:0/4000861511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c155df0 msgr2=0x7f167c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c155df0 0x7f167c0ad9b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1668009910 tx=0x7f16680091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 -- 172.21.15.110:0/4000861511 shutdown_connections 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c155df0 0x7f167c0ad9b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 --2- 172.21.15.110:0/4000861511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155a20 0x7f167c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 -- 172.21.15.110:0/4000861511 >> 172.21.15.110:0/4000861511 conn(0x7f167c0cb9b0 msgr2=0x7f167c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 -- 172.21.15.110:0/4000861511 shutdown_connections 2024-08-17T02:29:10.030 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.028+0000 7f1682e00640 1 -- 172.21.15.110:0/4000861511 wait complete. 2024-08-17T02:29:10.032 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.030+0000 7f1682e00640 1 Processor -- start 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.030+0000 7f1682e00640 1 -- start start 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f167c155a20 0x7f167c06c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 0x7f167c1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0aaaa0 con 0x7f167c06d7f0 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0a7d20 con 0x7f167c155a20 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1682e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0aad60 con 0x7f167c155df0 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51844/0 (socket says 172.21.15.110:51844) 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 -- 172.21.15.110:0/1302738356 learned_addr learned my addr 172.21.15.110:0/1302738356 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:10.033 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167b400640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f167c155a20 0x7f167c06c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1680e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 0x7f167c1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 -- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 msgr2=0x7f167c1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 0x7f167c1500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 -- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f167c155a20 msgr2=0x7f167c06c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f167c155a20 0x7f167c06c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f167be00640 1 -- 172.21.15.110:0/1302738356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009450 con 0x7f167c06d7f0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.031+0000 7f1680e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 0x7f167c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f167be00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f166c00d890 tx=0x7f166c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00de20 con 0x7f167c06d7f0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166c00b870 con 0x7f167c06d7f0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166c00bc10 con 0x7f167c06d7f0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0a74e0 con 0x7f167c06d7f0 2024-08-17T02:29:10.034 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.032+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c0a7050 con 0x7f167c06d7f0 2024-08-17T02:29:10.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.033+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c0a7240 con 0x7f167c06d7f0 2024-08-17T02:29:10.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.034+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f166c01e460 con 0x7f167c06d7f0 2024-08-17T02:29:10.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.035+0000 7f1673400640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 0x7f165c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.035+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f166c082a60 con 0x7f167c06d7f0 2024-08-17T02:29:10.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.035+0000 7f167b400640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 0x7f165c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.036+0000 7f167b400640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 0x7f165c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1668034000 tx=0x7f1668032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.039+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f167c0a7240 con 0x7f167c06d7f0 2024-08-17T02:29:10.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.211+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f167c0a7240 con 0x7f167c06d7f0 2024-08-17T02:29:10.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.212+0000 7f1673400640 1 -- 172.21.15.110:0/1302738356 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f167c0a7240 con 0x7f167c06d7f0 2024-08-17T02:29:10.212 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:10.213 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:08.857620+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:10.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 msgr2=0x7f165c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 0x7f165c067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1668034000 tx=0x7f1668032000 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 msgr2=0x7f167c0a6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f166c00d890 tx=0x7f166c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 shutdown_connections 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f165c065150 0x7f165c067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f167c155df0 0x7f167c1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f167c155a20 0x7f167c06c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 --2- 172.21.15.110:0/1302738356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f167c06d7f0 0x7f167c0a6b10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 >> 172.21.15.110:0/1302738356 conn(0x7f167c0cb9b0 msgr2=0x7f167c158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 shutdown_connections 2024-08-17T02:29:10.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.214+0000 7f1682e00640 1 -- 172.21.15.110:0/1302738356 wait complete. 2024-08-17T02:29:10.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:29:10.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.380+0000 7f7c7dc00640 1 Processor -- start 2024-08-17T02:29:10.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.380+0000 7f7c7dc00640 1 -- start start 2024-08-17T02:29:10.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.381+0000 7f7c7dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7c78155a80 0x7f7c7806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.381+0000 7f7c7dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c780c92e0 0x7f7c780aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c7dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c781598f0 con 0x7f7c780c7db0 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c7dc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c78159bd0 con 0x7f7c780c92e0 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c7dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c78159eb0 con 0x7f7c78155a80 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c780c92e0 0x7f7c780aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c6e000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7c780c7db0 0x7f7c780c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56396/0 (socket says 172.21.15.110:56396) 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c780c92e0 0x7f7c780aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51858/0 (socket says 172.21.15.110:51858) 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c6e000640 1 -- 172.21.15.110:0/2613718354 learned_addr learned my addr 172.21.15.110:0/2613718354 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c76a00640 1 --2- 172.21.15.110:0/2613718354 >> v2:172.21.15.177:3300/0 conn(0x7f7c78155a80 0x7f7c7806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 -- 172.21.15.110:0/2613718354 >> v2:172.21.15.177:3300/0 conn(0x7f7c78155a80 msgr2=0x7f7c7806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 --2- 172.21.15.110:0/2613718354 >> v2:172.21.15.177:3300/0 conn(0x7f7c78155a80 0x7f7c7806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 -- 172.21.15.110:0/2613718354 >> v1:172.21.15.110:6789/0 conn(0x7f7c780c7db0 legacy=0x7f7c780c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c76000640 1 -- 172.21.15.110:0/2613718354 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192244742 0 0) 0x7f7c781598f0 con 0x7f7c780c7db0 2024-08-17T02:29:10.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.382+0000 7f7c77400640 1 -- 172.21.15.110:0/2613718354 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7815a190 con 0x7f7c780c92e0 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.383+0000 7f7c77400640 1 --2- 172.21.15.110:0/2613718354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780aea40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806efd0 tx=0x7f7c70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa936cffdf68552a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.383+0000 7f7c76000640 1 -- 172.21.15.110:0/2613718354 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70007550 con 0x7f7c780c92e0 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.383+0000 7f7c76000640 1 -- 172.21.15.110:0/2613718354 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7002d050 con 0x7f7c780c92e0 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.383+0000 7f7c76000640 1 -- 172.21.15.110:0/2613718354 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700078e0 con 0x7f7c780c92e0 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 -- 172.21.15.110:0/2613718354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 msgr2=0x7f7c780aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/2613718354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780aea40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7c7806efd0 tx=0x7f7c70009780 comp rx=0 tx=0).stop 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 -- 172.21.15.110:0/2613718354 shutdown_connections 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/2613718354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780aea40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/2613718354 >> v2:172.21.15.177:3300/0 conn(0x7f7c78155a80 0x7f7c7806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 -- 172.21.15.110:0/2613718354 >> 172.21.15.110:0/2613718354 conn(0x7f7c78067750 msgr2=0x7f7c780c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:10.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 -- 172.21.15.110:0/2613718354 shutdown_connections 2024-08-17T02:29:10.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.384+0000 7f7c7dc00640 1 -- 172.21.15.110:0/2613718354 wait complete. 2024-08-17T02:29:10.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.385+0000 7f7c7dc00640 1 Processor -- start 2024-08-17T02:29:10.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 -- start start 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 0x7f7c7814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c78155a80 0x7f7c780ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78155390 con 0x7f7c780c92e0 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78156900 con 0x7f7c780c7db0 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.386+0000 7f7c7dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78155fd0 con 0x7f7c78155a80 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51866/0 (socket says 172.21.15.110:51866) 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 -- 172.21.15.110:0/1004184791 learned_addr learned my addr 172.21.15.110:0/1004184791 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c76a00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 0x7f7c7814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c77400640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c78155a80 0x7f7c780ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 -- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c78155a80 msgr2=0x7f7c780ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c78155a80 0x7f7c780ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 -- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 msgr2=0x7f7c7814fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 0x7f7c7814fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 -- 172.21.15.110:0/1004184791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009a20 con 0x7f7c780c92e0 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c76a00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 0x7f7c7814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.387+0000 7f7c6e000640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c590 tx=0x7f7c60007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.388+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60005aa0 con 0x7f7c780c92e0 2024-08-17T02:29:10.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.388+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c60005c00 con 0x7f7c780c92e0 2024-08-17T02:29:10.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.388+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781562b0 con 0x7f7c780c92e0 2024-08-17T02:29:10.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.388+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c600070f0 con 0x7f7c780c92e0 2024-08-17T02:29:10.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.388+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c78156d90 con 0x7f7c780c92e0 2024-08-17T02:29:10.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.389+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c78156a70 con 0x7f7c780c92e0 2024-08-17T02:29:10.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.390+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7c600074e0 con 0x7f7c780c92e0 2024-08-17T02:29:10.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.390+0000 7f7c6ea00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 0x7f7c54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:10.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.390+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7c60081f30 con 0x7f7c780c92e0 2024-08-17T02:29:10.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.391+0000 7f7c76a00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 0x7f7c54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:10.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.391+0000 7f7c76a00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 0x7f7c54067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800bbb0 tx=0x7f7c68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:10.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.395+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7c6004ffd0 con 0x7f7c780c92e0 2024-08-17T02:29:10.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:10.605+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c78071050 con 0x7f7c780c92e0 2024-08-17T02:29:11.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.481+0000 7f7c6ea00640 1 -- 172.21.15.110:0/1004184791 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c600535f0 con 0x7f7c780c92e0 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 msgr2=0x7f7c54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 0x7f7c54067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800bbb0 tx=0x7f7c68008040 comp rx=0 tx=0).stop 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 msgr2=0x7f7c780ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c590 tx=0x7f7c60007d20 comp rx=0 tx=0).stop 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 shutdown_connections 2024-08-17T02:29:11.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7c54065150 0x7f7c54067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c78155a80 0x7f7c780ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c780c92e0 0x7f7c780ad0f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 --2- 172.21.15.110:0/1004184791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c780c7db0 0x7f7c7814fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 >> 172.21.15.110:0/1004184791 conn(0x7f7c78067750 msgr2=0x7f7c780afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 shutdown_connections 2024-08-17T02:29:11.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.484+0000 7f7c7dc00640 1 -- 172.21.15.110:0/1004184791 wait complete. 2024-08-17T02:29:11.502 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:29:11.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.654+0000 7fd525200640 1 Processor -- start 2024-08-17T02:29:11.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.654+0000 7fd525200640 1 -- start start 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd525200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd520156c50 0x7fd5200c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd525200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5200adcf0 0x7fd5200ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd525200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5200ab130 con 0x7fd5200abb00 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd525200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200ae5a0 con 0x7fd5200adcf0 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd525200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5200ae2c0 con 0x7fd520156c50 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.655+0000 7fd51d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5200adcf0 0x7fd5200ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5200adcf0 0x7fd5200ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51878/0 (socket says 172.21.15.110:51878) 2024-08-17T02:29:11.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51e800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd5200abb00 0x7fd5200c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56410/0 (socket says 172.21.15.110:56410) 2024-08-17T02:29:11.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 -- 172.21.15.110:0/1307049866 learned_addr learned my addr 172.21.15.110:0/1307049866 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:11.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51de00640 1 --2- 172.21.15.110:0/1307049866 >> v2:172.21.15.177:3300/0 conn(0x7fd520156c50 0x7fd5200c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 -- 172.21.15.110:0/1307049866 >> v2:172.21.15.177:3300/0 conn(0x7fd520156c50 msgr2=0x7fd5200c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 --2- 172.21.15.110:0/1307049866 >> v2:172.21.15.177:3300/0 conn(0x7fd520156c50 0x7fd5200c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 -- 172.21.15.110:0/1307049866 >> v1:172.21.15.110:6789/0 conn(0x7fd5200abb00 legacy=0x7fd5200c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51d400640 1 -- 172.21.15.110:0/1307049866 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200aaae0 con 0x7fd5200adcf0 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.656+0000 7fd51ca00640 1 -- 172.21.15.110:0/1307049866 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117373529 0 0) 0x7fd5200ab130 con 0x7fd5200abb00 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.657+0000 7fd51d400640 1 --2- 172.21.15.110:0/1307049866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd5200ab5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd52006efd0 tx=0x7fd50c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188043dbb7cd8c61 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.657+0000 7fd51ca00640 1 -- 172.21.15.110:0/1307049866 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c02ad40 con 0x7fd5200adcf0 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.657+0000 7fd51ca00640 1 -- 172.21.15.110:0/1307049866 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c032440 con 0x7fd5200adcf0 2024-08-17T02:29:11.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.657+0000 7fd51ca00640 1 -- 172.21.15.110:0/1307049866 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c02aea0 con 0x7fd5200adcf0 2024-08-17T02:29:11.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 -- 172.21.15.110:0/1307049866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 msgr2=0x7fd5200ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 --2- 172.21.15.110:0/1307049866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd5200ab5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd52006efd0 tx=0x7fd50c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 -- 172.21.15.110:0/1307049866 shutdown_connections 2024-08-17T02:29:11.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 --2- 172.21.15.110:0/1307049866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd5200ab5c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 --2- 172.21.15.110:0/1307049866 >> v2:172.21.15.177:3300/0 conn(0x7fd520156c50 0x7fd5200c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 -- 172.21.15.110:0/1307049866 >> 172.21.15.110:0/1307049866 conn(0x7fd520067750 msgr2=0x7fd5200c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 -- 172.21.15.110:0/1307049866 shutdown_connections 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.658+0000 7fd525200640 1 -- 172.21.15.110:0/1307049866 wait complete. 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.659+0000 7fd525200640 1 Processor -- start 2024-08-17T02:29:11.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 -- start start 2024-08-17T02:29:11.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 0x7fd52013d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 0x7fd520153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520156290 con 0x7fd5200adcf0 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014ca00 con 0x7fd520156c50 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.660+0000 7fd525200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd520157cc0 con 0x7fd5200abb00 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51884/0 (socket says 172.21.15.110:51884) 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 -- 172.21.15.110:0/1439811024 learned_addr learned my addr 172.21.15.110:0/1439811024 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51e800640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 0x7fd520153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51de00640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 0x7fd52013d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 -- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 msgr2=0x7fd52013d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 0x7fd52013d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 -- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 msgr2=0x7fd520153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 0x7fd520153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 -- 172.21.15.110:0/1439811024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009450 con 0x7fd5200adcf0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51e800640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 0x7fd520153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51de00640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 0x7fd52013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.661+0000 7fd51d400640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009940 tx=0x7fd50c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.662+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c031830 con 0x7fd5200adcf0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.662+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0319b0 con 0x7fd5200adcf0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.662+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c031d70 con 0x7fd5200adcf0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.662+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520157fa0 con 0x7fd5200adcf0 2024-08-17T02:29:11.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.662+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520158560 con 0x7fd5200adcf0 2024-08-17T02:29:11.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.663+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520071050 con 0x7fd5200adcf0 2024-08-17T02:29:11.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.664+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd50c03c400 con 0x7fd5200adcf0 2024-08-17T02:29:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.664+0000 7fd515600640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 0x7fd500067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.665+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd50c0a2980 con 0x7fd5200adcf0 2024-08-17T02:29:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.665+0000 7fd51de00640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 0x7fd500067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:11.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.665+0000 7fd51de00640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 0x7fd500067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd510009c50 tx=0x7fd510008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:11.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.669+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd50c0709a0 con 0x7fd5200adcf0 2024-08-17T02:29:11.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:11.878+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd5200c9ff0 con 0x7fd5200adcf0 2024-08-17T02:29:12.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.482+0000 7fd515600640 1 -- 172.21.15.110:0/1439811024 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd50c073fc0 con 0x7fd5200adcf0 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 msgr2=0x7fd500067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 0x7fd500067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd510009c50 tx=0x7fd510008040 comp rx=0 tx=0).stop 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 msgr2=0x7fd520152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009940 tx=0x7fd50c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 shutdown_connections 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd500065150 0x7fd500067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd520156c50 0x7fd520153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5200adcf0 0x7fd520152bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 --2- 172.21.15.110:0/1439811024 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5200abb00 0x7fd52013d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.484+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 >> 172.21.15.110:0/1439811024 conn(0x7fd520067750 msgr2=0x7fd5200ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.485+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 shutdown_connections 2024-08-17T02:29:12.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.485+0000 7fd525200640 1 -- 172.21.15.110:0/1439811024 wait complete. 2024-08-17T02:29:12.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:12.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.648+0000 7f3a38a00640 1 Processor -- start 2024-08-17T02:29:12.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.648+0000 7f3a38a00640 1 -- start start 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a38a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a340cc430 0x7f3a340cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a38a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340ca700 con 0x7f3a34067ef0 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a38a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a340684f0 con 0x7f3a34062da0 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a38a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340682e0 con 0x7f3a340cc430 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a31e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a340cc430 0x7f3a340cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a32800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3a34067ef0 0x7f3a340cb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:56412/0 (socket says 172.21.15.110:56412) 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.649+0000 7f3a32800640 1 -- 172.21.15.110:0/2588645402 learned_addr learned my addr 172.21.15.110:0/2588645402 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:12.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.650+0000 7f3a31e00640 1 -- 172.21.15.110:0/2588645402 >> v1:172.21.15.177:6789/0 conn(0x7f3a34062da0 legacy=0x7f3a340cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.650+0000 7f3a31e00640 1 -- 172.21.15.110:0/2588645402 >> v1:172.21.15.110:6789/0 conn(0x7f3a34067ef0 legacy=0x7f3a340cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.650+0000 7f3a31e00640 1 -- 172.21.15.110:0/2588645402 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340c9dd0 con 0x7f3a340cc430 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a31e00640 1 --2- 172.21.15.110:0/2588645402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a340cc430 0x7f3a340cc800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca2b60bca328b8f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a30a00640 1 -- 172.21.15.110:0/2588645402 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402ae20 con 0x7f3a340cc430 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a30a00640 1 -- 172.21.15.110:0/2588645402 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a340cc430 2024-08-17T02:29:12.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a30a00640 1 -- 172.21.15.110:0/2588645402 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24032820 con 0x7f3a340cc430 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a38a00640 1 -- 172.21.15.110:0/2588645402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a340cc430 msgr2=0x7f3a340cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.651+0000 7f3a38a00640 1 --2- 172.21.15.110:0/2588645402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a340cc430 0x7f3a340cc800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a240090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.652+0000 7f3a38a00640 1 -- 172.21.15.110:0/2588645402 shutdown_connections 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.652+0000 7f3a38a00640 1 --2- 172.21.15.110:0/2588645402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a340cc430 0x7f3a340cc800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.652+0000 7f3a38a00640 1 -- 172.21.15.110:0/2588645402 >> 172.21.15.110:0/2588645402 conn(0x7f3a340afc30 msgr2=0x7f3a340b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.652+0000 7f3a38a00640 1 -- 172.21.15.110:0/2588645402 shutdown_connections 2024-08-17T02:29:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.652+0000 7f3a38a00640 1 -- 172.21.15.110:0/2588645402 wait complete. 2024-08-17T02:29:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.653+0000 7f3a38a00640 1 Processor -- start 2024-08-17T02:29:12.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.653+0000 7f3a38a00640 1 -- start start 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a34067ef0 0x7f3a340c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 0x7f3a340c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340c9470 con 0x7f3a34062da0 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340c88d0 con 0x7f3a34067ef0 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a38a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340c8b40 con 0x7f3a340cc430 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51904/0 (socket says 172.21.15.110:51904) 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a31e00640 1 -- 172.21.15.110:0/3635306447 learned_addr learned my addr 172.21.15.110:0/3635306447 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a32800640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 0x7f3a340c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.654+0000 7f3a31400640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a34067ef0 0x7f3a340c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 -- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 msgr2=0x7f3a340c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 0x7f3a340c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 -- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a34067ef0 msgr2=0x7f3a340c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a34067ef0 0x7f3a340c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 -- 172.21.15.110:0/3635306447 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24009390 con 0x7f3a34062da0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a32800640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 0x7f3a340c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a31e00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24031de0 con 0x7f3a34062da0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2403d420 con 0x7f3a34062da0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a340c8e20 con 0x7f3a34062da0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2403d7e0 con 0x7f3a34062da0 2024-08-17T02:29:12.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.655+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a34150030 con 0x7f3a34062da0 2024-08-17T02:29:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.656+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a34064db0 con 0x7f3a34062da0 2024-08-17T02:29:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.657+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a24039040 con 0x7f3a34062da0 2024-08-17T02:29:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.658+0000 7f3a29600640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 0x7f3a14067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:12.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.658+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a240a2800 con 0x7f3a34062da0 2024-08-17T02:29:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.658+0000 7f3a31400640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 0x7f3a14067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:12.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.659+0000 7f3a31400640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 0x7f3a14067630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a3406cc30 tx=0x7f3a20009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:12.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.662+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3a240708c0 con 0x7f3a34062da0 2024-08-17T02:29:12.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.870+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a340cd120 con 0x7f3a34062da0 2024-08-17T02:29:12.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.871+0000 7f3a29600640 1 -- 172.21.15.110:0/3635306447 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3a24073ee0 con 0x7f3a34062da0 2024-08-17T02:29:12.871 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:12.871 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:12.871 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:12.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.872+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 msgr2=0x7f3a14067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.872+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 0x7f3a14067630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a3406cc30 tx=0x7f3a20009040 comp rx=0 tx=0).stop 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 msgr2=0x7f3a3414faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a24032000 comp rx=0 tx=0).stop 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 shutdown_connections 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3a14065180 0x7f3a14067630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a340cc430 0x7f3a340c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a34067ef0 0x7f3a340c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 --2- 172.21.15.110:0/3635306447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a34062da0 0x7f3a3414faf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 >> 172.21.15.110:0/3635306447 conn(0x7f3a340afc30 msgr2=0x7f3a3406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 shutdown_connections 2024-08-17T02:29:12.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:12.873+0000 7f3a38a00640 1 -- 172.21.15.110:0/3635306447 wait complete. 2024-08-17T02:29:12.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:13.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.035+0000 7f39e4e00640 1 Processor -- start 2024-08-17T02:29:13.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.035+0000 7f39e4e00640 1 -- start start 2024-08-17T02:29:13.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39e0155a20 0x7f39e00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 0x7f39e00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e00b0350 con 0x7f39e0155df0 2024-08-17T02:29:13.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e0156670 con 0x7f39e0155a20 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39e4e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e006e180 con 0x7f39e006d7f0 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39dde00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39e0155a20 0x7f39e00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39d7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 0x7f39e00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39dde00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39e0155a20 0x7f39e00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:39802/0 (socket says 172.21.15.110:39802) 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.036+0000 7f39dde00640 1 -- 172.21.15.110:0/94839563 learned_addr learned my addr 172.21.15.110:0/94839563 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39de800640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39dde00640 1 -- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 msgr2=0x7f39e006dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39dde00640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39dde00640 1 -- 172.21.15.110:0/94839563 >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 msgr2=0x7f39e00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39dde00640 1 --2- 172.21.15.110:0/94839563 >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 0x7f39e00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39dde00640 1 -- 172.21.15.110:0/94839563 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e006e5e0 con 0x7f39e0155a20 2024-08-17T02:29:13.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.037+0000 7f39d7e00640 1 --2- 172.21.15.110:0/94839563 >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 0x7f39e00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:13.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.038+0000 7f39dde00640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155a20 0x7f39e00adf10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39e006bc00 tx=0x7f39d000b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e168813ea25c10ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.038+0000 7f39dd400640 1 -- 172.21.15.110:0/94839563 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0032640 con 0x7f39e0155a20 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.038+0000 7f39dd400640 1 -- 172.21.15.110:0/94839563 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00327a0 con 0x7f39e0155a20 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.038+0000 7f39dd400640 1 -- 172.21.15.110:0/94839563 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0032b80 con 0x7f39e0155a20 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 -- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155a20 msgr2=0x7f39e00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155a20 0x7f39e00adf10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f39e006bc00 tx=0x7f39d000b460 comp rx=0 tx=0).stop 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 -- 172.21.15.110:0/94839563 shutdown_connections 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 --2- 172.21.15.110:0/94839563 >> v2:172.21.15.110:3300/0 conn(0x7f39e0155df0 0x7f39e00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 --2- 172.21.15.110:0/94839563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155a20 0x7f39e00adf10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 -- 172.21.15.110:0/94839563 >> 172.21.15.110:0/94839563 conn(0x7f39e00cb9b0 msgr2=0x7f39e00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 -- 172.21.15.110:0/94839563 shutdown_connections 2024-08-17T02:29:13.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.039+0000 7f39e4e00640 1 -- 172.21.15.110:0/94839563 wait complete. 2024-08-17T02:29:13.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.040+0000 7f39e4e00640 1 Processor -- start 2024-08-17T02:29:13.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.040+0000 7f39e4e00640 1 -- start start 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 0x7f39e0153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e016cb10 con 0x7f39e0155a20 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e016d690 con 0x7f39e0155df0 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.041+0000 7f39e4e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e006a650 con 0x7f39e006d7f0 2024-08-17T02:29:13.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51918/0 (socket says 172.21.15.110:51918) 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 -- 172.21.15.110:0/1577502755 learned_addr learned my addr 172.21.15.110:0/1577502755 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39dde00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39de800640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 0x7f39e0153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 -- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 msgr2=0x7f39e006a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 -- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 msgr2=0x7f39e0153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 0x7f39e0153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 -- 172.21.15.110:0/1577502755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009390 con 0x7f39e0155a20 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39dde00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39de800640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 0x7f39e0153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d7e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39c800ea80 tx=0x7f39c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800ca10 con 0x7f39e0155a20 2024-08-17T02:29:13.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c800cb70 con 0x7f39e0155a20 2024-08-17T02:29:13.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.042+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8013470 con 0x7f39e0155a20 2024-08-17T02:29:13.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.043+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d000b700 con 0x7f39e0155a20 2024-08-17T02:29:13.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.043+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e016d040 con 0x7f39e0155a20 2024-08-17T02:29:13.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.044+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e0064db0 con 0x7f39e0155a20 2024-08-17T02:29:13.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.044+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f39c80137e0 con 0x7f39e0155a20 2024-08-17T02:29:13.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.045+0000 7f39d5600640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 0x7f39bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.045+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39c80825f0 con 0x7f39e0155a20 2024-08-17T02:29:13.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.045+0000 7f39dde00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 0x7f39bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.046+0000 7f39dde00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 0x7f39bc067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d0037000 tx=0x7f39d003a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.049+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f39c8050610 con 0x7f39e0155a20 2024-08-17T02:29:13.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.222+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39e006b170 con 0x7f39e0155a20 2024-08-17T02:29:13.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.223+0000 7f39d5600640 1 -- 172.21.15.110:0/1577502755 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f39c8053c30 con 0x7f39e0155a20 2024-08-17T02:29:13.223 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:13.224 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:13.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 msgr2=0x7f39bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 0x7f39bc067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f39d0037000 tx=0x7f39d003a000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 msgr2=0x7f39e01497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39c800ea80 tx=0x7f39c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 shutdown_connections 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f39bc065150 0x7f39bc067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e0155df0 0x7f39e0153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39e0155a20 0x7f39e01497a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 --2- 172.21.15.110:0/1577502755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39e006d7f0 0x7f39e006a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 >> 172.21.15.110:0/1577502755 conn(0x7f39e00cb9b0 msgr2=0x7f39e0156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 shutdown_connections 2024-08-17T02:29:13.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.225+0000 7f39e4e00640 1 -- 172.21.15.110:0/1577502755 wait complete. 2024-08-17T02:29:13.241 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:29:13.241 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.387+0000 7f6562800640 1 Processor -- start 2024-08-17T02:29:13.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.387+0000 7f6562800640 1 -- start start 2024-08-17T02:29:13.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.388+0000 7f6562800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.388+0000 7f6562800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f655c06df00 0x7f655c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f6562800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c156670 con 0x7f655c155df0 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f6562800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655c0b0350 con 0x7f655c06df00 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f6562800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c06e5e0 con 0x7f655c155a20 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:50882/0 (socket says 172.21.15.110:50882) 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 -- 172.21.15.110:0/1152107392 learned_addr learned my addr 172.21.15.110:0/1152107392 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655be00640 1 --2- 172.21.15.110:0/1152107392 >> v2:172.21.15.177:3300/0 conn(0x7f655c06df00 0x7f655c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 -- 172.21.15.110:0/1152107392 >> v2:172.21.15.177:3300/0 conn(0x7f655c06df00 msgr2=0x7f655c0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 --2- 172.21.15.110:0/1152107392 >> v2:172.21.15.177:3300/0 conn(0x7f655c06df00 0x7f655c0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 -- 172.21.15.110:0/1152107392 >> v1:172.21.15.177:6789/0 conn(0x7f655c155df0 legacy=0x7f655c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655aa00640 1 -- 172.21.15.110:0/1152107392 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28589386 0 0) 0x7f655c156670 con 0x7f655c155df0 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.389+0000 7f655b400640 1 -- 172.21.15.110:0/1152107392 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c06e8c0 con 0x7f655c155a20 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.390+0000 7f655b400640 1 --2- 172.21.15.110:0/1152107392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f654c009910 tx=0x7f654c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=854e5fae23a00694 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f655aa00640 1 -- 172.21.15.110:0/1152107392 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c02ae40 con 0x7f655c155a20 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f655aa00640 1 -- 172.21.15.110:0/1152107392 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c032440 con 0x7f655c155a20 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f655aa00640 1 -- 172.21.15.110:0/1152107392 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c0327e0 con 0x7f655c155a20 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 -- 172.21.15.110:0/1152107392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 msgr2=0x7f655c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 --2- 172.21.15.110:0/1152107392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f654c009910 tx=0x7f654c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 -- 172.21.15.110:0/1152107392 shutdown_connections 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 --2- 172.21.15.110:0/1152107392 >> v2:172.21.15.177:3300/0 conn(0x7f655c06df00 0x7f655c0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 --2- 172.21.15.110:0/1152107392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155a20 0x7f655c0adf10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 -- 172.21.15.110:0/1152107392 >> 172.21.15.110:0/1152107392 conn(0x7f655c0cb9b0 msgr2=0x7f655c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 -- 172.21.15.110:0/1152107392 shutdown_connections 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.391+0000 7f6562800640 1 -- 172.21.15.110:0/1152107392 wait complete. 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.393+0000 7f6562800640 1 Processor -- start 2024-08-17T02:29:13.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.393+0000 7f6562800640 1 -- start start 2024-08-17T02:29:13.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.393+0000 7f6562800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.393+0000 7f6562800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655c155a20 0x7f655c0abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f6562800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 0x7f655c0c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f6562800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0ad3a0 con 0x7f655c06df00 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f6562800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0ac790 con 0x7f655c155a20 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f6562800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c0aca70 con 0x7f655c155df0 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51930/0 (socket says 172.21.15.110:51930) 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 -- 172.21.15.110:0/1340521148 learned_addr learned my addr 172.21.15.110:0/1340521148 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655be00640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 0x7f655c0c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f6552a00640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655c155a20 0x7f655c0abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 -- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 msgr2=0x7f655c0c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 0x7f655c0c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 -- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655c155a20 msgr2=0x7f655c0abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655c155a20 0x7f655c0abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 -- 172.21.15.110:0/1340521148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c009450 con 0x7f655c06df00 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655be00640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 0x7f655c0c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.394+0000 7f655b400640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f654c035040 tx=0x7f654c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.395+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c031c80 con 0x7f655c06df00 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.395+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c031e00 con 0x7f655c06df00 2024-08-17T02:29:13.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.395+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c03d670 con 0x7f655c06df00 2024-08-17T02:29:13.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.395+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c0acd50 con 0x7f655c06df00 2024-08-17T02:29:13.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.395+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c0ab9f0 con 0x7f655c06df00 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.396+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c064db0 con 0x7f655c06df00 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.397+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f654c039040 con 0x7f655c06df00 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.397+0000 7f6553400640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.397+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f654c02ae40 con 0x7f655c06df00 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.398+0000 7f6552a00640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.398+0000 7f6552a00640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 0x7f6538067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f655c0b04c0 tx=0x7f65440015b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.401+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f654c070380 con 0x7f655c06df00 2024-08-17T02:29:13.517 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-08-17T02:29:13.516+0000 7f1888a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:13.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.578+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f655c154f30 con 0x7f6538065150 2024-08-17T02:29:13.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.586+0000 7f6553400640 1 -- 172.21.15.110:0/1340521148 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264636 (secure 0 0 0) 0x7f655c154f30 con 0x7f6538065150 2024-08-17T02:29:13.591 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:13.592 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 msgr2=0x7f6538067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 0x7f6538067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f655c0b04c0 tx=0x7f65440015b0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 msgr2=0x7f655c150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f654c035040 tx=0x7f654c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 shutdown_connections 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6538065150 0x7f6538067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f655c155df0 0x7f655c0c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f655c155a20 0x7f655c0abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 --2- 172.21.15.110:0/1340521148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f655c06df00 0x7f655c150be0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 >> 172.21.15.110:0/1340521148 conn(0x7f655c0cb9b0 msgr2=0x7f655c1526a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 shutdown_connections 2024-08-17T02:29:13.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.591+0000 7f6562800640 1 -- 172.21.15.110:0/1340521148 wait complete. 2024-08-17T02:29:13.606 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:29:13.436979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398776,"kb_used_data":2948,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575944,"statfs":{"total":773094113280,"available":770637766656,"internally_reserved":0,"allocated":3018752,"data_stored":1795316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503311+0000","last_change":"2024-08-17T02:29:09.500528+0000","last_active":"2024-08-17T02:29:09.503311+0000","last_peered":"2024-08-17T02:29:09.503311+0000","last_clean":"2024-08-17T02:29:09.503311+0000","last_became_active":"2024-08-17T02:29:09.500277+0000","last_became_peered":"2024-08-17T02:29:09.500277+0000","last_unstale":"2024-08-17T02:29:09.503311+0000","last_undegraded":"2024-08-17T02:29:09.503311+0000","last_fullsized":"2024-08-17T02:29:09.503311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494232+0000","last_change":"2024-08-17T02:29:09.488194+0000","last_active":"2024-08-17T02:29:09.494232+0000","last_peered":"2024-08-17T02:29:09.494232+0000","last_clean":"2024-08-17T02:29:09.494232+0000","last_became_active":"2024-08-17T02:29:09.487890+0000","last_became_peered":"2024-08-17T02:29:09.487890+0000","last_unstale":"2024-08-17T02:29:09.494232+0000","last_undegraded":"2024-08-17T02:29:09.494232+0000","last_fullsized":"2024-08-17T02:29:09.494232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.476701+0000","last_change":"2024-08-17T02:29:09.474732+0000","last_active":"2024-08-17T02:29:09.476701+0000","last_peered":"2024-08-17T02:29:09.476701+0000","last_clean":"2024-08-17T02:29:09.476701+0000","last_became_active":"2024-08-17T02:29:09.473873+0000","last_became_peered":"2024-08-17T02:29:09.473873+0000","last_unstale":"2024-08-17T02:29:09.476701+0000","last_undegraded":"2024-08-17T02:29:09.476701+0000","last_fullsized":"2024-08-17T02:29:09.476701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:05.177148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501146+0000","last_change":"2024-08-17T02:29:09.497768+0000","last_active":"2024-08-17T02:29:09.501146+0000","last_peered":"2024-08-17T02:29:09.501146+0000","last_clean":"2024-08-17T02:29:09.501146+0000","last_became_active":"2024-08-17T02:29:09.497468+0000","last_became_peered":"2024-08-17T02:29:09.497468+0000","last_unstale":"2024-08-17T02:29:09.501146+0000","last_undegraded":"2024-08-17T02:29:09.501146+0000","last_fullsized":"2024-08-17T02:29:09.501146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.505816+0000","last_change":"2024-08-17T02:29:09.503605+0000","last_active":"2024-08-17T02:29:09.505816+0000","last_peered":"2024-08-17T02:29:09.505816+0000","last_clean":"2024-08-17T02:29:09.505816+0000","last_became_active":"2024-08-17T02:29:09.503452+0000","last_became_peered":"2024-08-17T02:29:09.503452+0000","last_unstale":"2024-08-17T02:29:09.505816+0000","last_undegraded":"2024-08-17T02:29:09.505816+0000","last_fullsized":"2024-08-17T02:29:09.505816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501345+0000","last_change":"2024-08-17T02:29:09.498723+0000","last_active":"2024-08-17T02:29:09.501345+0000","last_peered":"2024-08-17T02:29:09.501345+0000","last_clean":"2024-08-17T02:29:09.501345+0000","last_became_active":"2024-08-17T02:29:09.498313+0000","last_became_peered":"2024-08-17T02:29:09.498313+0000","last_unstale":"2024-08-17T02:29:09.501345+0000","last_undegraded":"2024-08-17T02:29:09.501345+0000","last_fullsized":"2024-08-17T02:29:09.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502472+0000","last_change":"2024-08-17T02:29:09.494498+0000","last_active":"2024-08-17T02:29:09.502472+0000","last_peered":"2024-08-17T02:29:09.502472+0000","last_clean":"2024-08-17T02:29:09.502472+0000","last_became_active":"2024-08-17T02:29:09.494218+0000","last_became_peered":"2024-08-17T02:29:09.494218+0000","last_unstale":"2024-08-17T02:29:09.502472+0000","last_undegraded":"2024-08-17T02:29:09.502472+0000","last_fullsized":"2024-08-17T02:29:09.502472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492697+0000","last_change":"2024-08-17T02:29:09.491080+0000","last_active":"2024-08-17T02:29:09.492697+0000","last_peered":"2024-08-17T02:29:09.492697+0000","last_clean":"2024-08-17T02:29:09.492697+0000","last_became_active":"2024-08-17T02:29:09.490793+0000","last_became_peered":"2024-08-17T02:29:09.490793+0000","last_unstale":"2024-08-17T02:29:09.492697+0000","last_undegraded":"2024-08-17T02:29:09.492697+0000","last_fullsized":"2024-08-17T02:29:09.492697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503294+0000","last_change":"2024-08-17T02:29:09.498187+0000","last_active":"2024-08-17T02:29:09.503294+0000","last_peered":"2024-08-17T02:29:09.503294+0000","last_clean":"2024-08-17T02:29:09.503294+0000","last_became_active":"2024-08-17T02:29:09.491354+0000","last_became_peered":"2024-08-17T02:29:09.491354+0000","last_unstale":"2024-08-17T02:29:09.503294+0000","last_undegraded":"2024-08-17T02:29:09.503294+0000","last_fullsized":"2024-08-17T02:29:09.503294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:21.754886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494177+0000","last_change":"2024-08-17T02:29:09.484467+0000","last_active":"2024-08-17T02:29:09.494177+0000","last_peered":"2024-08-17T02:29:09.494177+0000","last_clean":"2024-08-17T02:29:09.494177+0000","last_became_active":"2024-08-17T02:29:09.483924+0000","last_became_peered":"2024-08-17T02:29:09.483924+0000","last_unstale":"2024-08-17T02:29:09.494177+0000","last_undegraded":"2024-08-17T02:29:09.494177+0000","last_fullsized":"2024-08-17T02:29:09.494177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.490799+0000","last_change":"2024-08-17T02:29:09.483777+0000","last_active":"2024-08-17T02:29:09.490799+0000","last_peered":"2024-08-17T02:29:09.490799+0000","last_clean":"2024-08-17T02:29:09.490799+0000","last_became_active":"2024-08-17T02:29:09.483532+0000","last_became_peered":"2024-08-17T02:29:09.483532+0000","last_unstale":"2024-08-17T02:29:09.490799+0000","last_undegraded":"2024-08-17T02:29:09.490799+0000","last_fullsized":"2024-08-17T02:29:09.490799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484875+0000","last_change":"2024-08-17T02:29:09.482400+0000","last_active":"2024-08-17T02:29:09.484875+0000","last_peered":"2024-08-17T02:29:09.484875+0000","last_clean":"2024-08-17T02:29:09.484875+0000","last_became_active":"2024-08-17T02:29:09.482163+0000","last_became_peered":"2024-08-17T02:29:09.482163+0000","last_unstale":"2024-08-17T02:29:09.484875+0000","last_undegraded":"2024-08-17T02:29:09.484875+0000","last_fullsized":"2024-08-17T02:29:09.484875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:22.158713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483651+0000","last_change":"2024-08-17T02:29:09.481502+0000","last_active":"2024-08-17T02:29:09.483651+0000","last_peered":"2024-08-17T02:29:09.483651+0000","last_clean":"2024-08-17T02:29:09.483651+0000","last_became_active":"2024-08-17T02:29:09.481144+0000","last_became_peered":"2024-08-17T02:29:09.481144+0000","last_unstale":"2024-08-17T02:29:09.483651+0000","last_undegraded":"2024-08-17T02:29:09.483651+0000","last_fullsized":"2024-08-17T02:29:09.483651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494273+0000","last_change":"2024-08-17T02:29:09.485218+0000","last_active":"2024-08-17T02:29:09.494273+0000","last_peered":"2024-08-17T02:29:09.494273+0000","last_clean":"2024-08-17T02:29:09.494273+0000","last_became_active":"2024-08-17T02:29:09.484159+0000","last_became_peered":"2024-08-17T02:29:09.484159+0000","last_unstale":"2024-08-17T02:29:09.494273+0000","last_undegraded":"2024-08-17T02:29:09.494273+0000","last_fullsized":"2024-08-17T02:29:09.494273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:52.833765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.485281+0000","last_change":"2024-08-17T02:29:09.483147+0000","last_active":"2024-08-17T02:29:09.485281+0000","last_peered":"2024-08-17T02:29:09.485281+0000","last_clean":"2024-08-17T02:29:09.485281+0000","last_became_active":"2024-08-17T02:29:09.482881+0000","last_became_peered":"2024-08-17T02:29:09.482881+0000","last_unstale":"2024-08-17T02:29:09.485281+0000","last_undegraded":"2024-08-17T02:29:09.485281+0000","last_fullsized":"2024-08-17T02:29:09.485281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501264+0000","last_change":"2024-08-17T02:29:09.498492+0000","last_active":"2024-08-17T02:29:09.501264+0000","last_peered":"2024-08-17T02:29:09.501264+0000","last_clean":"2024-08-17T02:29:09.501264+0000","last_became_active":"2024-08-17T02:29:09.498236+0000","last_became_peered":"2024-08-17T02:29:09.498236+0000","last_unstale":"2024-08-17T02:29:09.501264+0000","last_undegraded":"2024-08-17T02:29:09.501264+0000","last_fullsized":"2024-08-17T02:29:09.501264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500552+0000","last_change":"2024-08-17T02:29:09.496176+0000","last_active":"2024-08-17T02:29:09.500552+0000","last_peered":"2024-08-17T02:29:09.500552+0000","last_clean":"2024-08-17T02:29:09.500552+0000","last_became_active":"2024-08-17T02:29:09.495922+0000","last_became_peered":"2024-08-17T02:29:09.495922+0000","last_unstale":"2024-08-17T02:29:09.500552+0000","last_undegraded":"2024-08-17T02:29:09.500552+0000","last_fullsized":"2024-08-17T02:29:09.500552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.478155+0000","last_change":"2024-08-17T02:29:09.476022+0000","last_active":"2024-08-17T02:29:09.478155+0000","last_peered":"2024-08-17T02:29:09.478155+0000","last_clean":"2024-08-17T02:29:09.478155+0000","last_became_active":"2024-08-17T02:29:09.475294+0000","last_became_peered":"2024-08-17T02:29:09.475294+0000","last_unstale":"2024-08-17T02:29:09.478155+0000","last_undegraded":"2024-08-17T02:29:09.478155+0000","last_fullsized":"2024-08-17T02:29:09.478155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:16.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503872+0000","last_change":"2024-08-17T02:29:09.500224+0000","last_active":"2024-08-17T02:29:09.503872+0000","last_peered":"2024-08-17T02:29:09.503872+0000","last_clean":"2024-08-17T02:29:09.503872+0000","last_became_active":"2024-08-17T02:29:09.495511+0000","last_became_peered":"2024-08-17T02:29:09.495511+0000","last_unstale":"2024-08-17T02:29:09.503872+0000","last_undegraded":"2024-08-17T02:29:09.503872+0000","last_fullsized":"2024-08-17T02:29:09.503872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499576+0000","last_change":"2024-08-17T02:29:09.491171+0000","last_active":"2024-08-17T02:29:09.499576+0000","last_peered":"2024-08-17T02:29:09.499576+0000","last_clean":"2024-08-17T02:29:09.499576+0000","last_became_active":"2024-08-17T02:29:09.490441+0000","last_became_peered":"2024-08-17T02:29:09.490441+0000","last_unstale":"2024-08-17T02:29:09.499576+0000","last_undegraded":"2024-08-17T02:29:09.499576+0000","last_fullsized":"2024-08-17T02:29:09.499576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477202+0000","last_change":"2024-08-17T02:29:09.473529+0000","last_active":"2024-08-17T02:29:09.477202+0000","last_peered":"2024-08-17T02:29:09.477202+0000","last_clean":"2024-08-17T02:29:09.477202+0000","last_became_active":"2024-08-17T02:29:09.473153+0000","last_became_peered":"2024-08-17T02:29:09.473153+0000","last_unstale":"2024-08-17T02:29:09.477202+0000","last_undegraded":"2024-08-17T02:29:09.477202+0000","last_fullsized":"2024-08-17T02:29:09.477202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492664+0000","last_change":"2024-08-17T02:29:09.490340+0000","last_active":"2024-08-17T02:29:09.492664+0000","last_peered":"2024-08-17T02:29:09.492664+0000","last_clean":"2024-08-17T02:29:09.492664+0000","last_became_active":"2024-08-17T02:29:09.489870+0000","last_became_peered":"2024-08-17T02:29:09.489870+0000","last_unstale":"2024-08-17T02:29:09.492664+0000","last_undegraded":"2024-08-17T02:29:09.492664+0000","last_fullsized":"2024-08-17T02:29:09.492664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481752+0000","last_change":"2024-08-17T02:29:09.472840+0000","last_active":"2024-08-17T02:29:09.481752+0000","last_peered":"2024-08-17T02:29:09.481752+0000","last_clean":"2024-08-17T02:29:09.481752+0000","last_became_active":"2024-08-17T02:29:09.472553+0000","last_became_peered":"2024-08-17T02:29:09.472553+0000","last_unstale":"2024-08-17T02:29:09.481752+0000","last_undegraded":"2024-08-17T02:29:09.481752+0000","last_fullsized":"2024-08-17T02:29:09.481752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486135+0000","last_change":"2024-08-17T02:29:09.482798+0000","last_active":"2024-08-17T02:29:09.486135+0000","last_peered":"2024-08-17T02:29:09.486135+0000","last_clean":"2024-08-17T02:29:09.486135+0000","last_became_active":"2024-08-17T02:29:09.480991+0000","last_became_peered":"2024-08-17T02:29:09.480991+0000","last_unstale":"2024-08-17T02:29:09.486135+0000","last_undegraded":"2024-08-17T02:29:09.486135+0000","last_fullsized":"2024-08-17T02:29:09.486135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483656+0000","last_change":"2024-08-17T02:29:09.481066+0000","last_active":"2024-08-17T02:29:09.483656+0000","last_peered":"2024-08-17T02:29:09.483656+0000","last_clean":"2024-08-17T02:29:09.483656+0000","last_became_active":"2024-08-17T02:29:09.480760+0000","last_became_peered":"2024-08-17T02:29:09.480760+0000","last_unstale":"2024-08-17T02:29:09.483656+0000","last_undegraded":"2024-08-17T02:29:09.483656+0000","last_fullsized":"2024-08-17T02:29:09.483656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489725+0000","last_change":"2024-08-17T02:29:09.481328+0000","last_active":"2024-08-17T02:29:09.489725+0000","last_peered":"2024-08-17T02:29:09.489725+0000","last_clean":"2024-08-17T02:29:09.489725+0000","last_became_active":"2024-08-17T02:29:09.480207+0000","last_became_peered":"2024-08-17T02:29:09.480207+0000","last_unstale":"2024-08-17T02:29:09.489725+0000","last_undegraded":"2024-08-17T02:29:09.489725+0000","last_fullsized":"2024-08-17T02:29:09.489725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495304+0000","last_change":"2024-08-17T02:29:09.493921+0000","last_active":"2024-08-17T02:29:09.495304+0000","last_peered":"2024-08-17T02:29:09.495304+0000","last_clean":"2024-08-17T02:29:09.495304+0000","last_became_active":"2024-08-17T02:29:09.493466+0000","last_became_peered":"2024-08-17T02:29:09.493466+0000","last_unstale":"2024-08-17T02:29:09.495304+0000","last_undegraded":"2024-08-17T02:29:09.495304+0000","last_fullsized":"2024-08-17T02:29:09.495304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486278+0000","last_change":"2024-08-17T02:29:09.473340+0000","last_active":"2024-08-17T02:29:09.486278+0000","last_peered":"2024-08-17T02:29:09.486278+0000","last_clean":"2024-08-17T02:29:09.486278+0000","last_became_active":"2024-08-17T02:29:09.473031+0000","last_became_peered":"2024-08-17T02:29:09.473031+0000","last_unstale":"2024-08-17T02:29:09.486278+0000","last_undegraded":"2024-08-17T02:29:09.486278+0000","last_fullsized":"2024-08-17T02:29:09.486278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473205+0000","last_change":"2024-08-17T02:29:09.469323+0000","last_active":"2024-08-17T02:29:09.473205+0000","last_peered":"2024-08-17T02:29:09.473205+0000","last_clean":"2024-08-17T02:29:09.473205+0000","last_became_active":"2024-08-17T02:29:09.468822+0000","last_became_peered":"2024-08-17T02:29:09.468822+0000","last_unstale":"2024-08-17T02:29:09.473205+0000","last_undegraded":"2024-08-17T02:29:09.473205+0000","last_fullsized":"2024-08-17T02:29:09.473205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492646+0000","last_change":"2024-08-17T02:29:09.490137+0000","last_active":"2024-08-17T02:29:09.492646+0000","last_peered":"2024-08-17T02:29:09.492646+0000","last_clean":"2024-08-17T02:29:09.492646+0000","last_became_active":"2024-08-17T02:29:09.489622+0000","last_became_peered":"2024-08-17T02:29:09.489622+0000","last_unstale":"2024-08-17T02:29:09.492646+0000","last_undegraded":"2024-08-17T02:29:09.492646+0000","last_fullsized":"2024-08-17T02:29:09.492646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483236+0000","last_change":"2024-08-17T02:29:09.481874+0000","last_active":"2024-08-17T02:29:09.483236+0000","last_peered":"2024-08-17T02:29:09.483236+0000","last_clean":"2024-08-17T02:29:09.483236+0000","last_became_active":"2024-08-17T02:29:09.481627+0000","last_became_peered":"2024-08-17T02:29:09.481627+0000","last_unstale":"2024-08-17T02:29:09.483236+0000","last_undegraded":"2024-08-17T02:29:09.483236+0000","last_fullsized":"2024-08-17T02:29:09.483236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:54.522995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487202+0000","last_change":"2024-08-17T02:29:09.475428+0000","last_active":"2024-08-17T02:29:09.487202+0000","last_peered":"2024-08-17T02:29:09.487202+0000","last_clean":"2024-08-17T02:29:09.487202+0000","last_became_active":"2024-08-17T02:29:09.474993+0000","last_became_peered":"2024-08-17T02:29:09.474993+0000","last_unstale":"2024-08-17T02:29:09.487202+0000","last_undegraded":"2024-08-17T02:29:09.487202+0000","last_fullsized":"2024-08-17T02:29:09.487202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484961+0000","last_change":"2024-08-17T02:29:09.478702+0000","last_active":"2024-08-17T02:29:09.484961+0000","last_peered":"2024-08-17T02:29:09.484961+0000","last_clean":"2024-08-17T02:29:09.484961+0000","last_became_active":"2024-08-17T02:29:09.478413+0000","last_became_peered":"2024-08-17T02:29:09.478413+0000","last_unstale":"2024-08-17T02:29:09.484961+0000","last_undegraded":"2024-08-17T02:29:09.484961+0000","last_fullsized":"2024-08-17T02:29:09.484961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:49.001606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504251+0000","last_change":"2024-08-17T02:29:08.470650+0000","last_active":"2024-08-17T02:29:09.504251+0000","last_peered":"2024-08-17T02:29:09.504251+0000","last_clean":"2024-08-17T02:29:09.504251+0000","last_became_active":"2024-08-17T02:29:08.470347+0000","last_became_peered":"2024-08-17T02:29:08.470347+0000","last_unstale":"2024-08-17T02:29:09.504251+0000","last_undegraded":"2024-08-17T02:29:09.504251+0000","last_fullsized":"2024-08-17T02:29:09.504251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477184+0000","last_change":"2024-08-17T02:29:09.472832+0000","last_active":"2024-08-17T02:29:09.477184+0000","last_peered":"2024-08-17T02:29:09.477184+0000","last_clean":"2024-08-17T02:29:09.477184+0000","last_became_active":"2024-08-17T02:29:09.472581+0000","last_became_peered":"2024-08-17T02:29:09.472581+0000","last_unstale":"2024-08-17T02:29:09.477184+0000","last_undegraded":"2024-08-17T02:29:09.477184+0000","last_fullsized":"2024-08-17T02:29:09.477184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501308+0000","last_change":"2024-08-17T02:29:08.460904+0000","last_active":"2024-08-17T02:29:09.501308+0000","last_peered":"2024-08-17T02:29:09.501308+0000","last_clean":"2024-08-17T02:29:09.501308+0000","last_became_active":"2024-08-17T02:29:08.458813+0000","last_became_peered":"2024-08-17T02:29:08.458813+0000","last_unstale":"2024-08-17T02:29:09.501308+0000","last_undegraded":"2024-08-17T02:29:09.501308+0000","last_fullsized":"2024-08-17T02:29:09.501308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.465640+0000","last_change":"2024-08-17T02:29:08.469946+0000","last_active":"2024-08-17T02:29:09.465640+0000","last_peered":"2024-08-17T02:29:09.465640+0000","last_clean":"2024-08-17T02:29:09.465640+0000","last_became_active":"2024-08-17T02:29:08.469719+0000","last_became_peered":"2024-08-17T02:29:08.469719+0000","last_unstale":"2024-08-17T02:29:09.465640+0000","last_undegraded":"2024-08-17T02:29:09.465640+0000","last_fullsized":"2024-08-17T02:29:09.465640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483357+0000","last_change":"2024-08-17T02:29:09.480169+0000","last_active":"2024-08-17T02:29:09.483357+0000","last_peered":"2024-08-17T02:29:09.483357+0000","last_clean":"2024-08-17T02:29:09.483357+0000","last_became_active":"2024-08-17T02:29:09.479899+0000","last_became_peered":"2024-08-17T02:29:09.479899+0000","last_unstale":"2024-08-17T02:29:09.483357+0000","last_undegraded":"2024-08-17T02:29:09.483357+0000","last_fullsized":"2024-08-17T02:29:09.483357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468522+0000","last_change":"2024-08-17T02:29:08.463843+0000","last_active":"2024-08-17T02:29:09.468522+0000","last_peered":"2024-08-17T02:29:09.468522+0000","last_clean":"2024-08-17T02:29:09.468522+0000","last_became_active":"2024-08-17T02:29:08.463583+0000","last_became_peered":"2024-08-17T02:29:08.463583+0000","last_unstale":"2024-08-17T02:29:09.468522+0000","last_undegraded":"2024-08-17T02:29:09.468522+0000","last_fullsized":"2024-08-17T02:29:09.468522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488064+0000","last_change":"2024-08-17T02:29:09.485700+0000","last_active":"2024-08-17T02:29:09.488064+0000","last_peered":"2024-08-17T02:29:09.488064+0000","last_clean":"2024-08-17T02:29:09.488064+0000","last_became_active":"2024-08-17T02:29:09.485419+0000","last_became_peered":"2024-08-17T02:29:09.485419+0000","last_unstale":"2024-08-17T02:29:09.488064+0000","last_undegraded":"2024-08-17T02:29:09.488064+0000","last_fullsized":"2024-08-17T02:29:09.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470817+0000","last_change":"2024-08-17T02:29:08.476092+0000","last_active":"2024-08-17T02:29:09.470817+0000","last_peered":"2024-08-17T02:29:09.470817+0000","last_clean":"2024-08-17T02:29:09.470817+0000","last_became_active":"2024-08-17T02:29:08.475723+0000","last_became_peered":"2024-08-17T02:29:08.475723+0000","last_unstale":"2024-08-17T02:29:09.470817+0000","last_undegraded":"2024-08-17T02:29:09.470817+0000","last_fullsized":"2024-08-17T02:29:09.470817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484090+0000","last_change":"2024-08-17T02:29:09.481568+0000","last_active":"2024-08-17T02:29:09.484090+0000","last_peered":"2024-08-17T02:29:09.484090+0000","last_clean":"2024-08-17T02:29:09.484090+0000","last_became_active":"2024-08-17T02:29:09.481252+0000","last_became_peered":"2024-08-17T02:29:09.481252+0000","last_unstale":"2024-08-17T02:29:09.484090+0000","last_undegraded":"2024-08-17T02:29:09.484090+0000","last_fullsized":"2024-08-17T02:29:09.484090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468015+0000","last_change":"2024-08-17T02:29:08.477837+0000","last_active":"2024-08-17T02:29:09.468015+0000","last_peered":"2024-08-17T02:29:09.468015+0000","last_clean":"2024-08-17T02:29:09.468015+0000","last_became_active":"2024-08-17T02:29:08.477381+0000","last_became_peered":"2024-08-17T02:29:08.477381+0000","last_unstale":"2024-08-17T02:29:09.468015+0000","last_undegraded":"2024-08-17T02:29:09.468015+0000","last_fullsized":"2024-08-17T02:29:09.468015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494137+0000","last_change":"2024-08-17T02:29:09.490274+0000","last_active":"2024-08-17T02:29:09.494137+0000","last_peered":"2024-08-17T02:29:09.494137+0000","last_clean":"2024-08-17T02:29:09.494137+0000","last_became_active":"2024-08-17T02:29:09.489910+0000","last_became_peered":"2024-08-17T02:29:09.489910+0000","last_unstale":"2024-08-17T02:29:09.494137+0000","last_undegraded":"2024-08-17T02:29:09.494137+0000","last_fullsized":"2024-08-17T02:29:09.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495817+0000","last_change":"2024-08-17T02:29:08.470400+0000","last_active":"2024-08-17T02:29:09.495817+0000","last_peered":"2024-08-17T02:29:09.495817+0000","last_clean":"2024-08-17T02:29:09.495817+0000","last_became_active":"2024-08-17T02:29:08.470132+0000","last_became_peered":"2024-08-17T02:29:08.470132+0000","last_unstale":"2024-08-17T02:29:09.495817+0000","last_undegraded":"2024-08-17T02:29:09.495817+0000","last_fullsized":"2024-08-17T02:29:09.495817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483484+0000","last_change":"2024-08-17T02:29:09.476627+0000","last_active":"2024-08-17T02:29:09.483484+0000","last_peered":"2024-08-17T02:29:09.483484+0000","last_clean":"2024-08-17T02:29:09.483484+0000","last_became_active":"2024-08-17T02:29:09.475796+0000","last_became_peered":"2024-08-17T02:29:09.475796+0000","last_unstale":"2024-08-17T02:29:09.483484+0000","last_undegraded":"2024-08-17T02:29:09.483484+0000","last_fullsized":"2024-08-17T02:29:09.483484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.793675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.506084+0000","last_change":"2024-08-17T02:29:08.476918+0000","last_active":"2024-08-17T02:29:09.506084+0000","last_peered":"2024-08-17T02:29:09.506084+0000","last_clean":"2024-08-17T02:29:09.506084+0000","last_became_active":"2024-08-17T02:29:08.476398+0000","last_became_peered":"2024-08-17T02:29:08.476398+0000","last_unstale":"2024-08-17T02:29:09.506084+0000","last_undegraded":"2024-08-17T02:29:09.506084+0000","last_fullsized":"2024-08-17T02:29:09.506084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503892+0000","last_change":"2024-08-17T02:29:09.502218+0000","last_active":"2024-08-17T02:29:09.503892+0000","last_peered":"2024-08-17T02:29:09.503892+0000","last_clean":"2024-08-17T02:29:09.503892+0000","last_became_active":"2024-08-17T02:29:09.495867+0000","last_became_peered":"2024-08-17T02:29:09.495867+0000","last_unstale":"2024-08-17T02:29:09.503892+0000","last_undegraded":"2024-08-17T02:29:09.503892+0000","last_fullsized":"2024-08-17T02:29:09.503892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500523+0000","last_change":"2024-08-17T02:29:08.456255+0000","last_active":"2024-08-17T02:29:09.500523+0000","last_peered":"2024-08-17T02:29:09.500523+0000","last_clean":"2024-08-17T02:29:09.500523+0000","last_became_active":"2024-08-17T02:29:08.455951+0000","last_became_peered":"2024-08-17T02:29:08.455951+0000","last_unstale":"2024-08-17T02:29:09.500523+0000","last_undegraded":"2024-08-17T02:29:09.500523+0000","last_fullsized":"2024-08-17T02:29:09.500523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494299+0000","last_change":"2024-08-17T02:29:09.491084+0000","last_active":"2024-08-17T02:29:09.494299+0000","last_peered":"2024-08-17T02:29:09.494299+0000","last_clean":"2024-08-17T02:29:09.494299+0000","last_became_active":"2024-08-17T02:29:09.486223+0000","last_became_peered":"2024-08-17T02:29:09.486223+0000","last_unstale":"2024-08-17T02:29:09.494299+0000","last_undegraded":"2024-08-17T02:29:09.494299+0000","last_fullsized":"2024-08-17T02:29:09.494299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488081+0000","last_change":"2024-08-17T02:29:08.472582+0000","last_active":"2024-08-17T02:29:09.488081+0000","last_peered":"2024-08-17T02:29:09.488081+0000","last_clean":"2024-08-17T02:29:09.488081+0000","last_became_active":"2024-08-17T02:29:08.472353+0000","last_became_peered":"2024-08-17T02:29:08.472353+0000","last_unstale":"2024-08-17T02:29:09.488081+0000","last_undegraded":"2024-08-17T02:29:09.488081+0000","last_fullsized":"2024-08-17T02:29:09.488081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503846+0000","last_change":"2024-08-17T02:29:09.492684+0000","last_active":"2024-08-17T02:29:09.503846+0000","last_peered":"2024-08-17T02:29:09.503846+0000","last_clean":"2024-08-17T02:29:09.503846+0000","last_became_active":"2024-08-17T02:29:09.492444+0000","last_became_peered":"2024-08-17T02:29:09.492444+0000","last_unstale":"2024-08-17T02:29:09.503846+0000","last_undegraded":"2024-08-17T02:29:09.503846+0000","last_fullsized":"2024-08-17T02:29:09.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470244+0000","last_change":"2024-08-17T02:29:08.475729+0000","last_active":"2024-08-17T02:29:09.470244+0000","last_peered":"2024-08-17T02:29:09.470244+0000","last_clean":"2024-08-17T02:29:09.470244+0000","last_became_active":"2024-08-17T02:29:08.475476+0000","last_became_peered":"2024-08-17T02:29:08.475476+0000","last_unstale":"2024-08-17T02:29:09.470244+0000","last_undegraded":"2024-08-17T02:29:09.470244+0000","last_fullsized":"2024-08-17T02:29:09.470244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487181+0000","last_change":"2024-08-17T02:29:09.475265+0000","last_active":"2024-08-17T02:29:09.487181+0000","last_peered":"2024-08-17T02:29:09.487181+0000","last_clean":"2024-08-17T02:29:09.487181+0000","last_became_active":"2024-08-17T02:29:09.474621+0000","last_became_peered":"2024-08-17T02:29:09.474621+0000","last_unstale":"2024-08-17T02:29:09.487181+0000","last_undegraded":"2024-08-17T02:29:09.487181+0000","last_fullsized":"2024-08-17T02:29:09.487181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496446+0000","last_change":"2024-08-17T02:29:08.461859+0000","last_active":"2024-08-17T02:29:09.496446+0000","last_peered":"2024-08-17T02:29:09.496446+0000","last_clean":"2024-08-17T02:29:09.496446+0000","last_became_active":"2024-08-17T02:29:08.461535+0000","last_became_peered":"2024-08-17T02:29:08.461535+0000","last_unstale":"2024-08-17T02:29:09.496446+0000","last_undegraded":"2024-08-17T02:29:09.496446+0000","last_fullsized":"2024-08-17T02:29:09.496446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501548+0000","last_change":"2024-08-17T02:29:09.491129+0000","last_active":"2024-08-17T02:29:09.501548+0000","last_peered":"2024-08-17T02:29:09.501548+0000","last_clean":"2024-08-17T02:29:09.501548+0000","last_became_active":"2024-08-17T02:29:09.490847+0000","last_became_peered":"2024-08-17T02:29:09.490847+0000","last_unstale":"2024-08-17T02:29:09.501548+0000","last_undegraded":"2024-08-17T02:29:09.501548+0000","last_fullsized":"2024-08-17T02:29:09.501548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496485+0000","last_change":"2024-08-17T02:29:08.457588+0000","last_active":"2024-08-17T02:29:09.496485+0000","last_peered":"2024-08-17T02:29:09.496485+0000","last_clean":"2024-08-17T02:29:09.496485+0000","last_became_active":"2024-08-17T02:29:08.457346+0000","last_became_peered":"2024-08-17T02:29:08.457346+0000","last_unstale":"2024-08-17T02:29:09.496485+0000","last_undegraded":"2024-08-17T02:29:09.496485+0000","last_fullsized":"2024-08-17T02:29:09.496485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:08.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502379+0000","last_change":"2024-08-17T02:29:09.494028+0000","last_active":"2024-08-17T02:29:09.502379+0000","last_peered":"2024-08-17T02:29:09.502379+0000","last_clean":"2024-08-17T02:29:09.502379+0000","last_became_active":"2024-08-17T02:29:09.493737+0000","last_became_peered":"2024-08-17T02:29:09.493737+0000","last_unstale":"2024-08-17T02:29:09.502379+0000","last_undegraded":"2024-08-17T02:29:09.502379+0000","last_fullsized":"2024-08-17T02:29:09.502379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.491687+0000","last_change":"2024-08-17T02:29:08.466598+0000","last_active":"2024-08-17T02:29:09.491687+0000","last_peered":"2024-08-17T02:29:09.491687+0000","last_clean":"2024-08-17T02:29:09.491687+0000","last_became_active":"2024-08-17T02:29:08.466312+0000","last_became_peered":"2024-08-17T02:29:08.466312+0000","last_unstale":"2024-08-17T02:29:09.491687+0000","last_undegraded":"2024-08-17T02:29:09.491687+0000","last_fullsized":"2024-08-17T02:29:09.491687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504407+0000","last_change":"2024-08-17T02:29:09.503142+0000","last_active":"2024-08-17T02:29:09.504407+0000","last_peered":"2024-08-17T02:29:09.504407+0000","last_clean":"2024-08-17T02:29:09.504407+0000","last_became_active":"2024-08-17T02:29:09.500631+0000","last_became_peered":"2024-08-17T02:29:09.500631+0000","last_unstale":"2024-08-17T02:29:09.504407+0000","last_undegraded":"2024-08-17T02:29:09.504407+0000","last_fullsized":"2024-08-17T02:29:09.504407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496744+0000","last_change":"2024-08-17T02:29:08.461264+0000","last_active":"2024-08-17T02:29:09.496744+0000","last_peered":"2024-08-17T02:29:09.496744+0000","last_clean":"2024-08-17T02:29:09.496744+0000","last_became_active":"2024-08-17T02:29:08.460980+0000","last_became_peered":"2024-08-17T02:29:08.460980+0000","last_unstale":"2024-08-17T02:29:09.496744+0000","last_undegraded":"2024-08-17T02:29:09.496744+0000","last_fullsized":"2024-08-17T02:29:09.496744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494761+0000","last_change":"2024-08-17T02:29:09.491641+0000","last_active":"2024-08-17T02:29:09.494761+0000","last_peered":"2024-08-17T02:29:09.494761+0000","last_clean":"2024-08-17T02:29:09.494761+0000","last_became_active":"2024-08-17T02:29:09.491430+0000","last_became_peered":"2024-08-17T02:29:09.491430+0000","last_unstale":"2024-08-17T02:29:09.494761+0000","last_undegraded":"2024-08-17T02:29:09.494761+0000","last_fullsized":"2024-08-17T02:29:09.494761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466879+0000","last_change":"2024-08-17T02:29:08.471744+0000","last_active":"2024-08-17T02:29:09.466879+0000","last_peered":"2024-08-17T02:29:09.466879+0000","last_clean":"2024-08-17T02:29:09.466879+0000","last_became_active":"2024-08-17T02:29:08.471449+0000","last_became_peered":"2024-08-17T02:29:08.471449+0000","last_unstale":"2024-08-17T02:29:09.466879+0000","last_undegraded":"2024-08-17T02:29:09.466879+0000","last_fullsized":"2024-08-17T02:29:09.466879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504380+0000","last_change":"2024-08-17T02:29:09.502714+0000","last_active":"2024-08-17T02:29:09.504380+0000","last_peered":"2024-08-17T02:29:09.504380+0000","last_clean":"2024-08-17T02:29:09.504380+0000","last_became_active":"2024-08-17T02:29:09.502509+0000","last_became_peered":"2024-08-17T02:29:09.502509+0000","last_unstale":"2024-08-17T02:29:09.504380+0000","last_undegraded":"2024-08-17T02:29:09.504380+0000","last_fullsized":"2024-08-17T02:29:09.504380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:11.241240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475314+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:09.475314+0000","last_peered":"2024-08-17T02:29:09.475314+0000","last_clean":"2024-08-17T02:29:09.475314+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:09.475314+0000","last_undegraded":"2024-08-17T02:29:09.475314+0000","last_fullsized":"2024-08-17T02:29:09.475314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472401+0000","last_change":"2024-08-17T02:29:08.460254+0000","last_active":"2024-08-17T02:29:09.472401+0000","last_peered":"2024-08-17T02:29:09.472401+0000","last_clean":"2024-08-17T02:29:09.472401+0000","last_became_active":"2024-08-17T02:29:08.459985+0000","last_became_peered":"2024-08-17T02:29:08.459985+0000","last_unstale":"2024-08-17T02:29:09.472401+0000","last_undegraded":"2024-08-17T02:29:09.472401+0000","last_fullsized":"2024-08-17T02:29:09.472401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499667+0000","last_change":"2024-08-17T02:29:09.498589+0000","last_active":"2024-08-17T02:29:09.499667+0000","last_peered":"2024-08-17T02:29:09.499667+0000","last_clean":"2024-08-17T02:29:09.499667+0000","last_became_active":"2024-08-17T02:29:09.498056+0000","last_became_peered":"2024-08-17T02:29:09.498056+0000","last_unstale":"2024-08-17T02:29:09.499667+0000","last_undegraded":"2024-08-17T02:29:09.499667+0000","last_fullsized":"2024-08-17T02:29:09.499667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475226+0000","last_change":"2024-08-17T02:29:08.470766+0000","last_active":"2024-08-17T02:29:09.475226+0000","last_peered":"2024-08-17T02:29:09.475226+0000","last_clean":"2024-08-17T02:29:09.475226+0000","last_became_active":"2024-08-17T02:29:08.470301+0000","last_became_peered":"2024-08-17T02:29:08.470301+0000","last_unstale":"2024-08-17T02:29:09.475226+0000","last_undegraded":"2024-08-17T02:29:09.475226+0000","last_fullsized":"2024-08-17T02:29:09.475226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472473+0000","last_change":"2024-08-17T02:29:09.465345+0000","last_active":"2024-08-17T02:29:09.472473+0000","last_peered":"2024-08-17T02:29:09.472473+0000","last_clean":"2024-08-17T02:29:09.472473+0000","last_became_active":"2024-08-17T02:29:09.465075+0000","last_became_peered":"2024-08-17T02:29:09.465075+0000","last_unstale":"2024-08-17T02:29:09.472473+0000","last_undegraded":"2024-08-17T02:29:09.472473+0000","last_fullsized":"2024-08-17T02:29:09.472473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466876+0000","last_change":"2024-08-17T02:29:08.473928+0000","last_active":"2024-08-17T02:29:09.466876+0000","last_peered":"2024-08-17T02:29:09.466876+0000","last_clean":"2024-08-17T02:29:09.466876+0000","last_became_active":"2024-08-17T02:29:08.473189+0000","last_became_peered":"2024-08-17T02:29:08.473189+0000","last_unstale":"2024-08-17T02:29:09.466876+0000","last_undegraded":"2024-08-17T02:29:09.466876+0000","last_fullsized":"2024-08-17T02:29:09.466876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.479531+0000","last_change":"2024-08-17T02:29:09.477076+0000","last_active":"2024-08-17T02:29:09.479531+0000","last_peered":"2024-08-17T02:29:09.479531+0000","last_clean":"2024-08-17T02:29:09.479531+0000","last_became_active":"2024-08-17T02:29:09.476789+0000","last_became_peered":"2024-08-17T02:29:09.476789+0000","last_unstale":"2024-08-17T02:29:09.479531+0000","last_undegraded":"2024-08-17T02:29:09.479531+0000","last_fullsized":"2024-08-17T02:29:09.479531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488186+0000","last_change":"2024-08-17T02:29:08.472166+0000","last_active":"2024-08-17T02:29:09.488186+0000","last_peered":"2024-08-17T02:29:09.488186+0000","last_clean":"2024-08-17T02:29:09.488186+0000","last_became_active":"2024-08-17T02:29:08.471933+0000","last_became_peered":"2024-08-17T02:29:08.471933+0000","last_unstale":"2024-08-17T02:29:09.488186+0000","last_undegraded":"2024-08-17T02:29:09.488186+0000","last_fullsized":"2024-08-17T02:29:09.488186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484642+0000","last_change":"2024-08-17T02:29:09.478904+0000","last_active":"2024-08-17T02:29:09.484642+0000","last_peered":"2024-08-17T02:29:09.484642+0000","last_clean":"2024-08-17T02:29:09.484642+0000","last_became_active":"2024-08-17T02:29:09.476164+0000","last_became_peered":"2024-08-17T02:29:09.476164+0000","last_unstale":"2024-08-17T02:29:09.484642+0000","last_undegraded":"2024-08-17T02:29:09.484642+0000","last_fullsized":"2024-08-17T02:29:09.484642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:06.838621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474425+0000","last_change":"2024-08-17T02:29:08.461319+0000","last_active":"2024-08-17T02:29:09.474425+0000","last_peered":"2024-08-17T02:29:09.474425+0000","last_clean":"2024-08-17T02:29:09.474425+0000","last_became_active":"2024-08-17T02:29:08.460994+0000","last_became_peered":"2024-08-17T02:29:08.460994+0000","last_unstale":"2024-08-17T02:29:09.474425+0000","last_undegraded":"2024-08-17T02:29:09.474425+0000","last_fullsized":"2024-08-17T02:29:09.474425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501176+0000","last_change":"2024-08-17T02:29:09.498026+0000","last_active":"2024-08-17T02:29:09.501176+0000","last_peered":"2024-08-17T02:29:09.501176+0000","last_clean":"2024-08-17T02:29:09.501176+0000","last_became_active":"2024-08-17T02:29:09.497741+0000","last_became_peered":"2024-08-17T02:29:09.497741+0000","last_unstale":"2024-08-17T02:29:09.501176+0000","last_undegraded":"2024-08-17T02:29:09.501176+0000","last_fullsized":"2024-08-17T02:29:09.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484472+0000","last_change":"2024-08-17T02:29:08.471249+0000","last_active":"2024-08-17T02:29:09.484472+0000","last_peered":"2024-08-17T02:29:09.484472+0000","last_clean":"2024-08-17T02:29:09.484472+0000","last_became_active":"2024-08-17T02:29:08.470658+0000","last_became_peered":"2024-08-17T02:29:08.470658+0000","last_unstale":"2024-08-17T02:29:09.484472+0000","last_undegraded":"2024-08-17T02:29:09.484472+0000","last_fullsized":"2024-08-17T02:29:09.484472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477525+0000","last_change":"2024-08-17T02:29:09.475433+0000","last_active":"2024-08-17T02:29:09.477525+0000","last_peered":"2024-08-17T02:29:09.477525+0000","last_clean":"2024-08-17T02:29:09.477525+0000","last_became_active":"2024-08-17T02:29:09.475166+0000","last_became_peered":"2024-08-17T02:29:09.475166+0000","last_unstale":"2024-08-17T02:29:09.477525+0000","last_undegraded":"2024-08-17T02:29:09.477525+0000","last_fullsized":"2024-08-17T02:29:09.477525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474975+0000","last_change":"2024-08-17T02:29:08.473436+0000","last_active":"2024-08-17T02:29:09.474975+0000","last_peered":"2024-08-17T02:29:09.474975+0000","last_clean":"2024-08-17T02:29:09.474975+0000","last_became_active":"2024-08-17T02:29:08.473221+0000","last_became_peered":"2024-08-17T02:29:08.473221+0000","last_unstale":"2024-08-17T02:29:09.474975+0000","last_undegraded":"2024-08-17T02:29:09.474975+0000","last_fullsized":"2024-08-17T02:29:09.474975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483637+0000","last_change":"2024-08-17T02:29:09.480720+0000","last_active":"2024-08-17T02:29:09.483637+0000","last_peered":"2024-08-17T02:29:09.483637+0000","last_clean":"2024-08-17T02:29:09.483637+0000","last_became_active":"2024-08-17T02:29:09.480335+0000","last_became_peered":"2024-08-17T02:29:09.480335+0000","last_unstale":"2024-08-17T02:29:09.483637+0000","last_undegraded":"2024-08-17T02:29:09.483637+0000","last_fullsized":"2024-08-17T02:29:09.483637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504904+0000","last_change":"2024-08-17T02:29:08.473608+0000","last_active":"2024-08-17T02:29:09.504904+0000","last_peered":"2024-08-17T02:29:09.504904+0000","last_clean":"2024-08-17T02:29:09.504904+0000","last_became_active":"2024-08-17T02:29:08.473188+0000","last_became_peered":"2024-08-17T02:29:08.473188+0000","last_unstale":"2024-08-17T02:29:09.504904+0000","last_undegraded":"2024-08-17T02:29:09.504904+0000","last_fullsized":"2024-08-17T02:29:09.504904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494131+0000","last_change":"2024-08-17T02:29:09.488891+0000","last_active":"2024-08-17T02:29:09.494131+0000","last_peered":"2024-08-17T02:29:09.494131+0000","last_clean":"2024-08-17T02:29:09.494131+0000","last_became_active":"2024-08-17T02:29:09.486565+0000","last_became_peered":"2024-08-17T02:29:09.486565+0000","last_unstale":"2024-08-17T02:29:09.494131+0000","last_undegraded":"2024-08-17T02:29:09.494131+0000","last_fullsized":"2024-08-17T02:29:09.494131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475125+0000","last_change":"2024-08-17T02:29:08.470705+0000","last_active":"2024-08-17T02:29:09.475125+0000","last_peered":"2024-08-17T02:29:09.475125+0000","last_clean":"2024-08-17T02:29:09.475125+0000","last_became_active":"2024-08-17T02:29:08.469956+0000","last_became_peered":"2024-08-17T02:29:08.469956+0000","last_unstale":"2024-08-17T02:29:09.475125+0000","last_undegraded":"2024-08-17T02:29:09.475125+0000","last_fullsized":"2024-08-17T02:29:09.475125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481784+0000","last_change":"2024-08-17T02:29:09.473933+0000","last_active":"2024-08-17T02:29:09.481784+0000","last_peered":"2024-08-17T02:29:09.481784+0000","last_clean":"2024-08-17T02:29:09.481784+0000","last_became_active":"2024-08-17T02:29:09.473044+0000","last_became_peered":"2024-08-17T02:29:09.473044+0000","last_unstale":"2024-08-17T02:29:09.481784+0000","last_undegraded":"2024-08-17T02:29:09.481784+0000","last_fullsized":"2024-08-17T02:29:09.481784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.880794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473548+0000","last_change":"2024-08-17T02:29:08.470009+0000","last_active":"2024-08-17T02:29:09.473548+0000","last_peered":"2024-08-17T02:29:09.473548+0000","last_clean":"2024-08-17T02:29:09.473548+0000","last_became_active":"2024-08-17T02:29:08.469646+0000","last_became_peered":"2024-08-17T02:29:08.469646+0000","last_unstale":"2024-08-17T02:29:09.473548+0000","last_undegraded":"2024-08-17T02:29:09.473548+0000","last_fullsized":"2024-08-17T02:29:09.473548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483992+0000","last_change":"2024-08-17T02:29:09.481399+0000","last_active":"2024-08-17T02:29:09.483992+0000","last_peered":"2024-08-17T02:29:09.483992+0000","last_clean":"2024-08-17T02:29:09.483992+0000","last_became_active":"2024-08-17T02:29:09.481104+0000","last_became_peered":"2024-08-17T02:29:09.481104+0000","last_unstale":"2024-08-17T02:29:09.483992+0000","last_undegraded":"2024-08-17T02:29:09.483992+0000","last_fullsized":"2024-08-17T02:29:09.483992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473744+0000","last_change":"2024-08-17T02:29:08.468611+0000","last_active":"2024-08-17T02:29:09.473744+0000","last_peered":"2024-08-17T02:29:09.473744+0000","last_clean":"2024-08-17T02:29:09.473744+0000","last_became_active":"2024-08-17T02:29:08.468075+0000","last_became_peered":"2024-08-17T02:29:08.468075+0000","last_unstale":"2024-08-17T02:29:09.473744+0000","last_undegraded":"2024-08-17T02:29:09.473744+0000","last_fullsized":"2024-08-17T02:29:09.473744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483055+0000","last_change":"2024-08-17T02:29:09.474989+0000","last_active":"2024-08-17T02:29:09.483055+0000","last_peered":"2024-08-17T02:29:09.483055+0000","last_clean":"2024-08-17T02:29:09.483055+0000","last_became_active":"2024-08-17T02:29:09.474717+0000","last_became_peered":"2024-08-17T02:29:09.474717+0000","last_unstale":"2024-08-17T02:29:09.483055+0000","last_undegraded":"2024-08-17T02:29:09.483055+0000","last_fullsized":"2024-08-17T02:29:09.483055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494182+0000","last_change":"2024-08-17T02:29:08.474152+0000","last_active":"2024-08-17T02:29:09.494182+0000","last_peered":"2024-08-17T02:29:09.494182+0000","last_clean":"2024-08-17T02:29:09.494182+0000","last_became_active":"2024-08-17T02:29:08.473850+0000","last_became_peered":"2024-08-17T02:29:08.473850+0000","last_unstale":"2024-08-17T02:29:09.494182+0000","last_undegraded":"2024-08-17T02:29:09.494182+0000","last_fullsized":"2024-08-17T02:29:09.494182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489628+0000","last_change":"2024-08-17T02:29:09.480093+0000","last_active":"2024-08-17T02:29:09.489628+0000","last_peered":"2024-08-17T02:29:09.489628+0000","last_clean":"2024-08-17T02:29:09.489628+0000","last_became_active":"2024-08-17T02:29:09.472172+0000","last_became_peered":"2024-08-17T02:29:09.472172+0000","last_unstale":"2024-08-17T02:29:09.489628+0000","last_undegraded":"2024-08-17T02:29:09.489628+0000","last_fullsized":"2024-08-17T02:29:09.489628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499201+0000","last_change":"2024-08-17T02:29:09.494902+0000","last_active":"2024-08-17T02:29:09.499201+0000","last_peered":"2024-08-17T02:29:09.499201+0000","last_clean":"2024-08-17T02:29:09.499201+0000","last_became_active":"2024-08-17T02:29:09.491782+0000","last_became_peered":"2024-08-17T02:29:09.491782+0000","last_unstale":"2024-08-17T02:29:09.499201+0000","last_undegraded":"2024-08-17T02:29:09.499201+0000","last_fullsized":"2024-08-17T02:29:09.499201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502069+0000","last_change":"2024-08-17T02:29:08.475348+0000","last_active":"2024-08-17T02:29:09.502069+0000","last_peered":"2024-08-17T02:29:09.502069+0000","last_clean":"2024-08-17T02:29:09.502069+0000","last_became_active":"2024-08-17T02:29:08.475111+0000","last_became_peered":"2024-08-17T02:29:08.475111+0000","last_unstale":"2024-08-17T02:29:09.502069+0000","last_undegraded":"2024-08-17T02:29:09.502069+0000","last_fullsized":"2024-08-17T02:29:09.502069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:21:10.249183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.497333+0000","last_change":"2024-08-17T02:29:09.492777+0000","last_active":"2024-08-17T02:29:09.497333+0000","last_peered":"2024-08-17T02:29:09.497333+0000","last_clean":"2024-08-17T02:29:09.497333+0000","last_became_active":"2024-08-17T02:29:09.492531+0000","last_became_peered":"2024-08-17T02:29:09.492531+0000","last_unstale":"2024-08-17T02:29:09.497333+0000","last_undegraded":"2024-08-17T02:29:09.497333+0000","last_fullsized":"2024-08-17T02:29:09.497333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502308+0000","last_change":"2024-08-17T02:29:08.473691+0000","last_active":"2024-08-17T02:29:09.502308+0000","last_peered":"2024-08-17T02:29:09.502308+0000","last_clean":"2024-08-17T02:29:09.502308+0000","last_became_active":"2024-08-17T02:29:08.473411+0000","last_became_peered":"2024-08-17T02:29:08.473411+0000","last_unstale":"2024-08-17T02:29:09.502308+0000","last_undegraded":"2024-08-17T02:29:09.502308+0000","last_fullsized":"2024-08-17T02:29:09.502308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494186+0000","last_change":"2024-08-17T02:29:09.492743+0000","last_active":"2024-08-17T02:29:09.494186+0000","last_peered":"2024-08-17T02:29:09.494186+0000","last_clean":"2024-08-17T02:29:09.494186+0000","last_became_active":"2024-08-17T02:29:09.492489+0000","last_became_peered":"2024-08-17T02:29:09.492489+0000","last_unstale":"2024-08-17T02:29:09.494186+0000","last_undegraded":"2024-08-17T02:29:09.494186+0000","last_fullsized":"2024-08-17T02:29:09.494186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494368+0000","last_change":"2024-08-17T02:29:08.462205+0000","last_active":"2024-08-17T02:29:09.494368+0000","last_peered":"2024-08-17T02:29:09.494368+0000","last_clean":"2024-08-17T02:29:09.494368+0000","last_became_active":"2024-08-17T02:29:08.461965+0000","last_became_peered":"2024-08-17T02:29:08.461965+0000","last_unstale":"2024-08-17T02:29:09.494368+0000","last_undegraded":"2024-08-17T02:29:09.494368+0000","last_fullsized":"2024-08-17T02:29:09.494368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489475+0000","last_change":"2024-08-17T02:29:09.481257+0000","last_active":"2024-08-17T02:29:09.489475+0000","last_peered":"2024-08-17T02:29:09.489475+0000","last_clean":"2024-08-17T02:29:09.489475+0000","last_became_active":"2024-08-17T02:29:09.480977+0000","last_became_peered":"2024-08-17T02:29:09.480977+0000","last_unstale":"2024-08-17T02:29:09.489475+0000","last_undegraded":"2024-08-17T02:29:09.489475+0000","last_fullsized":"2024-08-17T02:29:09.489475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503649+0000","last_change":"2024-08-17T02:29:08.459843+0000","last_active":"2024-08-17T02:29:09.503649+0000","last_peered":"2024-08-17T02:29:09.503649+0000","last_clean":"2024-08-17T02:29:09.503649+0000","last_became_active":"2024-08-17T02:29:08.459311+0000","last_became_peered":"2024-08-17T02:29:08.459311+0000","last_unstale":"2024-08-17T02:29:09.503649+0000","last_undegraded":"2024-08-17T02:29:09.503649+0000","last_fullsized":"2024-08-17T02:29:09.503649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:14.102117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":811008,"data_stored":663246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":72308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":819200,"data_stored":663302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:13.612 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:13.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.794+0000 7ff374e00640 1 Processor -- start 2024-08-17T02:29:13.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.794+0000 7ff374e00640 1 -- start start 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff374e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff370155550 0x7ff3700aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff374e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37006e080 0x7ff37006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff374e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3700afc10 con 0x7ff370155180 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff374e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37006ea00 con 0x7ff370155550 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff374e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3700af000 con 0x7ff37006e080 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff370155550 0x7ff3700aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff370155550 0x7ff3700aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51932/0 (socket says 172.21.15.110:51932) 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 -- 172.21.15.110:0/4087953713 learned_addr learned my addr 172.21.15.110:0/4087953713 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff36e800640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37006e080 0x7ff37006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 -- 172.21.15.110:0/4087953713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37006e080 msgr2=0x7ff37006e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37006e080 0x7ff37006e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 -- 172.21.15.110:0/4087953713 >> v1:172.21.15.177:6789/0 conn(0x7ff370155180 legacy=0x7ff3700ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff365400640 1 -- 172.21.15.110:0/4087953713 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3700af2e0 con 0x7ff370155550 2024-08-17T02:29:13.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.796+0000 7ff36d400640 1 -- 172.21.15.110:0/4087953713 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979348281 0 0) 0x7ff3700afc10 con 0x7ff370155180 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.797+0000 7ff365400640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff3700aea20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bbf0 tx=0x7ff35800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279e44fa710ccbd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff36d400640 1 -- 172.21.15.110:0/4087953713 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358031610 con 0x7ff370155550 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff36d400640 1 -- 172.21.15.110:0/4087953713 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358031770 con 0x7ff370155550 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff36d400640 1 -- 172.21.15.110:0/4087953713 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358031b10 con 0x7ff370155550 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 -- 172.21.15.110:0/4087953713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 msgr2=0x7ff3700aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff3700aea20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff35800bbf0 tx=0x7ff35800b460 comp rx=0 tx=0).stop 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 -- 172.21.15.110:0/4087953713 shutdown_connections 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff37006e080 0x7ff37006e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 --2- 172.21.15.110:0/4087953713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff3700aea20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 -- 172.21.15.110:0/4087953713 >> 172.21.15.110:0/4087953713 conn(0x7ff3700cb9b0 msgr2=0x7ff3700cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 -- 172.21.15.110:0/4087953713 shutdown_connections 2024-08-17T02:29:13.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.798+0000 7ff374e00640 1 -- 172.21.15.110:0/4087953713 wait complete. 2024-08-17T02:29:13.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.800+0000 7ff374e00640 1 Processor -- start 2024-08-17T02:29:13.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.800+0000 7ff374e00640 1 -- start start 2024-08-17T02:29:13.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37006e080 0x7ff3701569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff370155180 0x7ff3700abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370166fb0 con 0x7ff370155550 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff370157a70 con 0x7ff37006e080 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff374e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff370166c80 con 0x7ff370155180 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37006e080 0x7ff3701569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:51938/0 (socket says 172.21.15.110:51938) 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 -- 172.21.15.110:0/1759978566 learned_addr learned my addr 172.21.15.110:0/1759978566 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff365400640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff370155180 0x7ff3700abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 -- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff370155180 msgr2=0x7ff3700abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff370155180 0x7ff3700abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 -- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37006e080 msgr2=0x7ff3701569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37006e080 0x7ff3701569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.801+0000 7ff36e800640 1 -- 172.21.15.110:0/1759978566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35800b700 con 0x7ff370155550 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff36e800640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff368009e90 tx=0x7ff36800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36800ce10 con 0x7ff370155550 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36800f040 con 0x7ff370155550 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3680146d0 con 0x7ff370155550 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3701574b0 con 0x7ff370155550 2024-08-17T02:29:13.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.802+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37016d270 con 0x7ff370155550 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.803+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff370167120 con 0x7ff370155550 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.804+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff368014a80 con 0x7ff370155550 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.804+0000 7ff366000640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 0x7ff34c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.805+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff368082fb0 con 0x7ff370155550 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.805+0000 7ff36de00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 0x7ff34c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:13.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.805+0000 7ff36de00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 0x7ff34c067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3600011e0 tx=0x7ff360007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:13.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.808+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff368054b10 con 0x7ff370155550 2024-08-17T02:29:13.950 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:13.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:13.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.983+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff370064db0 con 0x7ff34c065150 2024-08-17T02:29:13.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.990+0000 7ff366000640 1 -- 172.21.15.110:0/1759978566 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264636 (secure 0 0 0) 0x7ff370064db0 con 0x7ff34c065150 2024-08-17T02:29:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:13.995 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 msgr2=0x7ff34c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 0x7ff34c067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff3600011e0 tx=0x7ff360007cc0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 msgr2=0x7ff37016c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff368009e90 tx=0x7ff36800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 shutdown_connections 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff34c065150 0x7ff34c067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff370155550 0x7ff37016c510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff370155180 0x7ff3700abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 --2- 172.21.15.110:0/1759978566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff37006e080 0x7ff3701569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:13.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.994+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 >> 172.21.15.110:0/1759978566 conn(0x7ff3700cb9b0 msgr2=0x7ff370151660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.995+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 shutdown_connections 2024-08-17T02:29:13.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:13.995+0000 7ff374e00640 1 -- 172.21.15.110:0/1759978566 wait complete. 2024-08-17T02:29:14.011 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:29:13.436979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398776,"kb_used_data":2948,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575944,"statfs":{"total":773094113280,"available":770637766656,"internally_reserved":0,"allocated":3018752,"data_stored":1795316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989680"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503311+0000","last_change":"2024-08-17T02:29:09.500528+0000","last_active":"2024-08-17T02:29:09.503311+0000","last_peered":"2024-08-17T02:29:09.503311+0000","last_clean":"2024-08-17T02:29:09.503311+0000","last_became_active":"2024-08-17T02:29:09.500277+0000","last_became_peered":"2024-08-17T02:29:09.500277+0000","last_unstale":"2024-08-17T02:29:09.503311+0000","last_undegraded":"2024-08-17T02:29:09.503311+0000","last_fullsized":"2024-08-17T02:29:09.503311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494232+0000","last_change":"2024-08-17T02:29:09.488194+0000","last_active":"2024-08-17T02:29:09.494232+0000","last_peered":"2024-08-17T02:29:09.494232+0000","last_clean":"2024-08-17T02:29:09.494232+0000","last_became_active":"2024-08-17T02:29:09.487890+0000","last_became_peered":"2024-08-17T02:29:09.487890+0000","last_unstale":"2024-08-17T02:29:09.494232+0000","last_undegraded":"2024-08-17T02:29:09.494232+0000","last_fullsized":"2024-08-17T02:29:09.494232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.476701+0000","last_change":"2024-08-17T02:29:09.474732+0000","last_active":"2024-08-17T02:29:09.476701+0000","last_peered":"2024-08-17T02:29:09.476701+0000","last_clean":"2024-08-17T02:29:09.476701+0000","last_became_active":"2024-08-17T02:29:09.473873+0000","last_became_peered":"2024-08-17T02:29:09.473873+0000","last_unstale":"2024-08-17T02:29:09.476701+0000","last_undegraded":"2024-08-17T02:29:09.476701+0000","last_fullsized":"2024-08-17T02:29:09.476701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:05.177148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501146+0000","last_change":"2024-08-17T02:29:09.497768+0000","last_active":"2024-08-17T02:29:09.501146+0000","last_peered":"2024-08-17T02:29:09.501146+0000","last_clean":"2024-08-17T02:29:09.501146+0000","last_became_active":"2024-08-17T02:29:09.497468+0000","last_became_peered":"2024-08-17T02:29:09.497468+0000","last_unstale":"2024-08-17T02:29:09.501146+0000","last_undegraded":"2024-08-17T02:29:09.501146+0000","last_fullsized":"2024-08-17T02:29:09.501146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.505816+0000","last_change":"2024-08-17T02:29:09.503605+0000","last_active":"2024-08-17T02:29:09.505816+0000","last_peered":"2024-08-17T02:29:09.505816+0000","last_clean":"2024-08-17T02:29:09.505816+0000","last_became_active":"2024-08-17T02:29:09.503452+0000","last_became_peered":"2024-08-17T02:29:09.503452+0000","last_unstale":"2024-08-17T02:29:09.505816+0000","last_undegraded":"2024-08-17T02:29:09.505816+0000","last_fullsized":"2024-08-17T02:29:09.505816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501345+0000","last_change":"2024-08-17T02:29:09.498723+0000","last_active":"2024-08-17T02:29:09.501345+0000","last_peered":"2024-08-17T02:29:09.501345+0000","last_clean":"2024-08-17T02:29:09.501345+0000","last_became_active":"2024-08-17T02:29:09.498313+0000","last_became_peered":"2024-08-17T02:29:09.498313+0000","last_unstale":"2024-08-17T02:29:09.501345+0000","last_undegraded":"2024-08-17T02:29:09.501345+0000","last_fullsized":"2024-08-17T02:29:09.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502472+0000","last_change":"2024-08-17T02:29:09.494498+0000","last_active":"2024-08-17T02:29:09.502472+0000","last_peered":"2024-08-17T02:29:09.502472+0000","last_clean":"2024-08-17T02:29:09.502472+0000","last_became_active":"2024-08-17T02:29:09.494218+0000","last_became_peered":"2024-08-17T02:29:09.494218+0000","last_unstale":"2024-08-17T02:29:09.502472+0000","last_undegraded":"2024-08-17T02:29:09.502472+0000","last_fullsized":"2024-08-17T02:29:09.502472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492697+0000","last_change":"2024-08-17T02:29:09.491080+0000","last_active":"2024-08-17T02:29:09.492697+0000","last_peered":"2024-08-17T02:29:09.492697+0000","last_clean":"2024-08-17T02:29:09.492697+0000","last_became_active":"2024-08-17T02:29:09.490793+0000","last_became_peered":"2024-08-17T02:29:09.490793+0000","last_unstale":"2024-08-17T02:29:09.492697+0000","last_undegraded":"2024-08-17T02:29:09.492697+0000","last_fullsized":"2024-08-17T02:29:09.492697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503294+0000","last_change":"2024-08-17T02:29:09.498187+0000","last_active":"2024-08-17T02:29:09.503294+0000","last_peered":"2024-08-17T02:29:09.503294+0000","last_clean":"2024-08-17T02:29:09.503294+0000","last_became_active":"2024-08-17T02:29:09.491354+0000","last_became_peered":"2024-08-17T02:29:09.491354+0000","last_unstale":"2024-08-17T02:29:09.503294+0000","last_undegraded":"2024-08-17T02:29:09.503294+0000","last_fullsized":"2024-08-17T02:29:09.503294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:21.754886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494177+0000","last_change":"2024-08-17T02:29:09.484467+0000","last_active":"2024-08-17T02:29:09.494177+0000","last_peered":"2024-08-17T02:29:09.494177+0000","last_clean":"2024-08-17T02:29:09.494177+0000","last_became_active":"2024-08-17T02:29:09.483924+0000","last_became_peered":"2024-08-17T02:29:09.483924+0000","last_unstale":"2024-08-17T02:29:09.494177+0000","last_undegraded":"2024-08-17T02:29:09.494177+0000","last_fullsized":"2024-08-17T02:29:09.494177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.490799+0000","last_change":"2024-08-17T02:29:09.483777+0000","last_active":"2024-08-17T02:29:09.490799+0000","last_peered":"2024-08-17T02:29:09.490799+0000","last_clean":"2024-08-17T02:29:09.490799+0000","last_became_active":"2024-08-17T02:29:09.483532+0000","last_became_peered":"2024-08-17T02:29:09.483532+0000","last_unstale":"2024-08-17T02:29:09.490799+0000","last_undegraded":"2024-08-17T02:29:09.490799+0000","last_fullsized":"2024-08-17T02:29:09.490799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484875+0000","last_change":"2024-08-17T02:29:09.482400+0000","last_active":"2024-08-17T02:29:09.484875+0000","last_peered":"2024-08-17T02:29:09.484875+0000","last_clean":"2024-08-17T02:29:09.484875+0000","last_became_active":"2024-08-17T02:29:09.482163+0000","last_became_peered":"2024-08-17T02:29:09.482163+0000","last_unstale":"2024-08-17T02:29:09.484875+0000","last_undegraded":"2024-08-17T02:29:09.484875+0000","last_fullsized":"2024-08-17T02:29:09.484875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:22.158713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483651+0000","last_change":"2024-08-17T02:29:09.481502+0000","last_active":"2024-08-17T02:29:09.483651+0000","last_peered":"2024-08-17T02:29:09.483651+0000","last_clean":"2024-08-17T02:29:09.483651+0000","last_became_active":"2024-08-17T02:29:09.481144+0000","last_became_peered":"2024-08-17T02:29:09.481144+0000","last_unstale":"2024-08-17T02:29:09.483651+0000","last_undegraded":"2024-08-17T02:29:09.483651+0000","last_fullsized":"2024-08-17T02:29:09.483651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494273+0000","last_change":"2024-08-17T02:29:09.485218+0000","last_active":"2024-08-17T02:29:09.494273+0000","last_peered":"2024-08-17T02:29:09.494273+0000","last_clean":"2024-08-17T02:29:09.494273+0000","last_became_active":"2024-08-17T02:29:09.484159+0000","last_became_peered":"2024-08-17T02:29:09.484159+0000","last_unstale":"2024-08-17T02:29:09.494273+0000","last_undegraded":"2024-08-17T02:29:09.494273+0000","last_fullsized":"2024-08-17T02:29:09.494273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:52.833765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.485281+0000","last_change":"2024-08-17T02:29:09.483147+0000","last_active":"2024-08-17T02:29:09.485281+0000","last_peered":"2024-08-17T02:29:09.485281+0000","last_clean":"2024-08-17T02:29:09.485281+0000","last_became_active":"2024-08-17T02:29:09.482881+0000","last_became_peered":"2024-08-17T02:29:09.482881+0000","last_unstale":"2024-08-17T02:29:09.485281+0000","last_undegraded":"2024-08-17T02:29:09.485281+0000","last_fullsized":"2024-08-17T02:29:09.485281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501264+0000","last_change":"2024-08-17T02:29:09.498492+0000","last_active":"2024-08-17T02:29:09.501264+0000","last_peered":"2024-08-17T02:29:09.501264+0000","last_clean":"2024-08-17T02:29:09.501264+0000","last_became_active":"2024-08-17T02:29:09.498236+0000","last_became_peered":"2024-08-17T02:29:09.498236+0000","last_unstale":"2024-08-17T02:29:09.501264+0000","last_undegraded":"2024-08-17T02:29:09.501264+0000","last_fullsized":"2024-08-17T02:29:09.501264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500552+0000","last_change":"2024-08-17T02:29:09.496176+0000","last_active":"2024-08-17T02:29:09.500552+0000","last_peered":"2024-08-17T02:29:09.500552+0000","last_clean":"2024-08-17T02:29:09.500552+0000","last_became_active":"2024-08-17T02:29:09.495922+0000","last_became_peered":"2024-08-17T02:29:09.495922+0000","last_unstale":"2024-08-17T02:29:09.500552+0000","last_undegraded":"2024-08-17T02:29:09.500552+0000","last_fullsized":"2024-08-17T02:29:09.500552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.478155+0000","last_change":"2024-08-17T02:29:09.476022+0000","last_active":"2024-08-17T02:29:09.478155+0000","last_peered":"2024-08-17T02:29:09.478155+0000","last_clean":"2024-08-17T02:29:09.478155+0000","last_became_active":"2024-08-17T02:29:09.475294+0000","last_became_peered":"2024-08-17T02:29:09.475294+0000","last_unstale":"2024-08-17T02:29:09.478155+0000","last_undegraded":"2024-08-17T02:29:09.478155+0000","last_fullsized":"2024-08-17T02:29:09.478155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:16.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503872+0000","last_change":"2024-08-17T02:29:09.500224+0000","last_active":"2024-08-17T02:29:09.503872+0000","last_peered":"2024-08-17T02:29:09.503872+0000","last_clean":"2024-08-17T02:29:09.503872+0000","last_became_active":"2024-08-17T02:29:09.495511+0000","last_became_peered":"2024-08-17T02:29:09.495511+0000","last_unstale":"2024-08-17T02:29:09.503872+0000","last_undegraded":"2024-08-17T02:29:09.503872+0000","last_fullsized":"2024-08-17T02:29:09.503872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499576+0000","last_change":"2024-08-17T02:29:09.491171+0000","last_active":"2024-08-17T02:29:09.499576+0000","last_peered":"2024-08-17T02:29:09.499576+0000","last_clean":"2024-08-17T02:29:09.499576+0000","last_became_active":"2024-08-17T02:29:09.490441+0000","last_became_peered":"2024-08-17T02:29:09.490441+0000","last_unstale":"2024-08-17T02:29:09.499576+0000","last_undegraded":"2024-08-17T02:29:09.499576+0000","last_fullsized":"2024-08-17T02:29:09.499576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477202+0000","last_change":"2024-08-17T02:29:09.473529+0000","last_active":"2024-08-17T02:29:09.477202+0000","last_peered":"2024-08-17T02:29:09.477202+0000","last_clean":"2024-08-17T02:29:09.477202+0000","last_became_active":"2024-08-17T02:29:09.473153+0000","last_became_peered":"2024-08-17T02:29:09.473153+0000","last_unstale":"2024-08-17T02:29:09.477202+0000","last_undegraded":"2024-08-17T02:29:09.477202+0000","last_fullsized":"2024-08-17T02:29:09.477202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492664+0000","last_change":"2024-08-17T02:29:09.490340+0000","last_active":"2024-08-17T02:29:09.492664+0000","last_peered":"2024-08-17T02:29:09.492664+0000","last_clean":"2024-08-17T02:29:09.492664+0000","last_became_active":"2024-08-17T02:29:09.489870+0000","last_became_peered":"2024-08-17T02:29:09.489870+0000","last_unstale":"2024-08-17T02:29:09.492664+0000","last_undegraded":"2024-08-17T02:29:09.492664+0000","last_fullsized":"2024-08-17T02:29:09.492664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481752+0000","last_change":"2024-08-17T02:29:09.472840+0000","last_active":"2024-08-17T02:29:09.481752+0000","last_peered":"2024-08-17T02:29:09.481752+0000","last_clean":"2024-08-17T02:29:09.481752+0000","last_became_active":"2024-08-17T02:29:09.472553+0000","last_became_peered":"2024-08-17T02:29:09.472553+0000","last_unstale":"2024-08-17T02:29:09.481752+0000","last_undegraded":"2024-08-17T02:29:09.481752+0000","last_fullsized":"2024-08-17T02:29:09.481752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486135+0000","last_change":"2024-08-17T02:29:09.482798+0000","last_active":"2024-08-17T02:29:09.486135+0000","last_peered":"2024-08-17T02:29:09.486135+0000","last_clean":"2024-08-17T02:29:09.486135+0000","last_became_active":"2024-08-17T02:29:09.480991+0000","last_became_peered":"2024-08-17T02:29:09.480991+0000","last_unstale":"2024-08-17T02:29:09.486135+0000","last_undegraded":"2024-08-17T02:29:09.486135+0000","last_fullsized":"2024-08-17T02:29:09.486135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483656+0000","last_change":"2024-08-17T02:29:09.481066+0000","last_active":"2024-08-17T02:29:09.483656+0000","last_peered":"2024-08-17T02:29:09.483656+0000","last_clean":"2024-08-17T02:29:09.483656+0000","last_became_active":"2024-08-17T02:29:09.480760+0000","last_became_peered":"2024-08-17T02:29:09.480760+0000","last_unstale":"2024-08-17T02:29:09.483656+0000","last_undegraded":"2024-08-17T02:29:09.483656+0000","last_fullsized":"2024-08-17T02:29:09.483656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489725+0000","last_change":"2024-08-17T02:29:09.481328+0000","last_active":"2024-08-17T02:29:09.489725+0000","last_peered":"2024-08-17T02:29:09.489725+0000","last_clean":"2024-08-17T02:29:09.489725+0000","last_became_active":"2024-08-17T02:29:09.480207+0000","last_became_peered":"2024-08-17T02:29:09.480207+0000","last_unstale":"2024-08-17T02:29:09.489725+0000","last_undegraded":"2024-08-17T02:29:09.489725+0000","last_fullsized":"2024-08-17T02:29:09.489725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495304+0000","last_change":"2024-08-17T02:29:09.493921+0000","last_active":"2024-08-17T02:29:09.495304+0000","last_peered":"2024-08-17T02:29:09.495304+0000","last_clean":"2024-08-17T02:29:09.495304+0000","last_became_active":"2024-08-17T02:29:09.493466+0000","last_became_peered":"2024-08-17T02:29:09.493466+0000","last_unstale":"2024-08-17T02:29:09.495304+0000","last_undegraded":"2024-08-17T02:29:09.495304+0000","last_fullsized":"2024-08-17T02:29:09.495304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486278+0000","last_change":"2024-08-17T02:29:09.473340+0000","last_active":"2024-08-17T02:29:09.486278+0000","last_peered":"2024-08-17T02:29:09.486278+0000","last_clean":"2024-08-17T02:29:09.486278+0000","last_became_active":"2024-08-17T02:29:09.473031+0000","last_became_peered":"2024-08-17T02:29:09.473031+0000","last_unstale":"2024-08-17T02:29:09.486278+0000","last_undegraded":"2024-08-17T02:29:09.486278+0000","last_fullsized":"2024-08-17T02:29:09.486278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473205+0000","last_change":"2024-08-17T02:29:09.469323+0000","last_active":"2024-08-17T02:29:09.473205+0000","last_peered":"2024-08-17T02:29:09.473205+0000","last_clean":"2024-08-17T02:29:09.473205+0000","last_became_active":"2024-08-17T02:29:09.468822+0000","last_became_peered":"2024-08-17T02:29:09.468822+0000","last_unstale":"2024-08-17T02:29:09.473205+0000","last_undegraded":"2024-08-17T02:29:09.473205+0000","last_fullsized":"2024-08-17T02:29:09.473205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492646+0000","last_change":"2024-08-17T02:29:09.490137+0000","last_active":"2024-08-17T02:29:09.492646+0000","last_peered":"2024-08-17T02:29:09.492646+0000","last_clean":"2024-08-17T02:29:09.492646+0000","last_became_active":"2024-08-17T02:29:09.489622+0000","last_became_peered":"2024-08-17T02:29:09.489622+0000","last_unstale":"2024-08-17T02:29:09.492646+0000","last_undegraded":"2024-08-17T02:29:09.492646+0000","last_fullsized":"2024-08-17T02:29:09.492646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483236+0000","last_change":"2024-08-17T02:29:09.481874+0000","last_active":"2024-08-17T02:29:09.483236+0000","last_peered":"2024-08-17T02:29:09.483236+0000","last_clean":"2024-08-17T02:29:09.483236+0000","last_became_active":"2024-08-17T02:29:09.481627+0000","last_became_peered":"2024-08-17T02:29:09.481627+0000","last_unstale":"2024-08-17T02:29:09.483236+0000","last_undegraded":"2024-08-17T02:29:09.483236+0000","last_fullsized":"2024-08-17T02:29:09.483236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:54.522995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487202+0000","last_change":"2024-08-17T02:29:09.475428+0000","last_active":"2024-08-17T02:29:09.487202+0000","last_peered":"2024-08-17T02:29:09.487202+0000","last_clean":"2024-08-17T02:29:09.487202+0000","last_became_active":"2024-08-17T02:29:09.474993+0000","last_became_peered":"2024-08-17T02:29:09.474993+0000","last_unstale":"2024-08-17T02:29:09.487202+0000","last_undegraded":"2024-08-17T02:29:09.487202+0000","last_fullsized":"2024-08-17T02:29:09.487202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484961+0000","last_change":"2024-08-17T02:29:09.478702+0000","last_active":"2024-08-17T02:29:09.484961+0000","last_peered":"2024-08-17T02:29:09.484961+0000","last_clean":"2024-08-17T02:29:09.484961+0000","last_became_active":"2024-08-17T02:29:09.478413+0000","last_became_peered":"2024-08-17T02:29:09.478413+0000","last_unstale":"2024-08-17T02:29:09.484961+0000","last_undegraded":"2024-08-17T02:29:09.484961+0000","last_fullsized":"2024-08-17T02:29:09.484961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:49.001606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504251+0000","last_change":"2024-08-17T02:29:08.470650+0000","last_active":"2024-08-17T02:29:09.504251+0000","last_peered":"2024-08-17T02:29:09.504251+0000","last_clean":"2024-08-17T02:29:09.504251+0000","last_became_active":"2024-08-17T02:29:08.470347+0000","last_became_peered":"2024-08-17T02:29:08.470347+0000","last_unstale":"2024-08-17T02:29:09.504251+0000","last_undegraded":"2024-08-17T02:29:09.504251+0000","last_fullsized":"2024-08-17T02:29:09.504251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477184+0000","last_change":"2024-08-17T02:29:09.472832+0000","last_active":"2024-08-17T02:29:09.477184+0000","last_peered":"2024-08-17T02:29:09.477184+0000","last_clean":"2024-08-17T02:29:09.477184+0000","last_became_active":"2024-08-17T02:29:09.472581+0000","last_became_peered":"2024-08-17T02:29:09.472581+0000","last_unstale":"2024-08-17T02:29:09.477184+0000","last_undegraded":"2024-08-17T02:29:09.477184+0000","last_fullsized":"2024-08-17T02:29:09.477184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501308+0000","last_change":"2024-08-17T02:29:08.460904+0000","last_active":"2024-08-17T02:29:09.501308+0000","last_peered":"2024-08-17T02:29:09.501308+0000","last_clean":"2024-08-17T02:29:09.501308+0000","last_became_active":"2024-08-17T02:29:08.458813+0000","last_became_peered":"2024-08-17T02:29:08.458813+0000","last_unstale":"2024-08-17T02:29:09.501308+0000","last_undegraded":"2024-08-17T02:29:09.501308+0000","last_fullsized":"2024-08-17T02:29:09.501308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.465640+0000","last_change":"2024-08-17T02:29:08.469946+0000","last_active":"2024-08-17T02:29:09.465640+0000","last_peered":"2024-08-17T02:29:09.465640+0000","last_clean":"2024-08-17T02:29:09.465640+0000","last_became_active":"2024-08-17T02:29:08.469719+0000","last_became_peered":"2024-08-17T02:29:08.469719+0000","last_unstale":"2024-08-17T02:29:09.465640+0000","last_undegraded":"2024-08-17T02:29:09.465640+0000","last_fullsized":"2024-08-17T02:29:09.465640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483357+0000","last_change":"2024-08-17T02:29:09.480169+0000","last_active":"2024-08-17T02:29:09.483357+0000","last_peered":"2024-08-17T02:29:09.483357+0000","last_clean":"2024-08-17T02:29:09.483357+0000","last_became_active":"2024-08-17T02:29:09.479899+0000","last_became_peered":"2024-08-17T02:29:09.479899+0000","last_unstale":"2024-08-17T02:29:09.483357+0000","last_undegraded":"2024-08-17T02:29:09.483357+0000","last_fullsized":"2024-08-17T02:29:09.483357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468522+0000","last_change":"2024-08-17T02:29:08.463843+0000","last_active":"2024-08-17T02:29:09.468522+0000","last_peered":"2024-08-17T02:29:09.468522+0000","last_clean":"2024-08-17T02:29:09.468522+0000","last_became_active":"2024-08-17T02:29:08.463583+0000","last_became_peered":"2024-08-17T02:29:08.463583+0000","last_unstale":"2024-08-17T02:29:09.468522+0000","last_undegraded":"2024-08-17T02:29:09.468522+0000","last_fullsized":"2024-08-17T02:29:09.468522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488064+0000","last_change":"2024-08-17T02:29:09.485700+0000","last_active":"2024-08-17T02:29:09.488064+0000","last_peered":"2024-08-17T02:29:09.488064+0000","last_clean":"2024-08-17T02:29:09.488064+0000","last_became_active":"2024-08-17T02:29:09.485419+0000","last_became_peered":"2024-08-17T02:29:09.485419+0000","last_unstale":"2024-08-17T02:29:09.488064+0000","last_undegraded":"2024-08-17T02:29:09.488064+0000","last_fullsized":"2024-08-17T02:29:09.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470817+0000","last_change":"2024-08-17T02:29:08.476092+0000","last_active":"2024-08-17T02:29:09.470817+0000","last_peered":"2024-08-17T02:29:09.470817+0000","last_clean":"2024-08-17T02:29:09.470817+0000","last_became_active":"2024-08-17T02:29:08.475723+0000","last_became_peered":"2024-08-17T02:29:08.475723+0000","last_unstale":"2024-08-17T02:29:09.470817+0000","last_undegraded":"2024-08-17T02:29:09.470817+0000","last_fullsized":"2024-08-17T02:29:09.470817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484090+0000","last_change":"2024-08-17T02:29:09.481568+0000","last_active":"2024-08-17T02:29:09.484090+0000","last_peered":"2024-08-17T02:29:09.484090+0000","last_clean":"2024-08-17T02:29:09.484090+0000","last_became_active":"2024-08-17T02:29:09.481252+0000","last_became_peered":"2024-08-17T02:29:09.481252+0000","last_unstale":"2024-08-17T02:29:09.484090+0000","last_undegraded":"2024-08-17T02:29:09.484090+0000","last_fullsized":"2024-08-17T02:29:09.484090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468015+0000","last_change":"2024-08-17T02:29:08.477837+0000","last_active":"2024-08-17T02:29:09.468015+0000","last_peered":"2024-08-17T02:29:09.468015+0000","last_clean":"2024-08-17T02:29:09.468015+0000","last_became_active":"2024-08-17T02:29:08.477381+0000","last_became_peered":"2024-08-17T02:29:08.477381+0000","last_unstale":"2024-08-17T02:29:09.468015+0000","last_undegraded":"2024-08-17T02:29:09.468015+0000","last_fullsized":"2024-08-17T02:29:09.468015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494137+0000","last_change":"2024-08-17T02:29:09.490274+0000","last_active":"2024-08-17T02:29:09.494137+0000","last_peered":"2024-08-17T02:29:09.494137+0000","last_clean":"2024-08-17T02:29:09.494137+0000","last_became_active":"2024-08-17T02:29:09.489910+0000","last_became_peered":"2024-08-17T02:29:09.489910+0000","last_unstale":"2024-08-17T02:29:09.494137+0000","last_undegraded":"2024-08-17T02:29:09.494137+0000","last_fullsized":"2024-08-17T02:29:09.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495817+0000","last_change":"2024-08-17T02:29:08.470400+0000","last_active":"2024-08-17T02:29:09.495817+0000","last_peered":"2024-08-17T02:29:09.495817+0000","last_clean":"2024-08-17T02:29:09.495817+0000","last_became_active":"2024-08-17T02:29:08.470132+0000","last_became_peered":"2024-08-17T02:29:08.470132+0000","last_unstale":"2024-08-17T02:29:09.495817+0000","last_undegraded":"2024-08-17T02:29:09.495817+0000","last_fullsized":"2024-08-17T02:29:09.495817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483484+0000","last_change":"2024-08-17T02:29:09.476627+0000","last_active":"2024-08-17T02:29:09.483484+0000","last_peered":"2024-08-17T02:29:09.483484+0000","last_clean":"2024-08-17T02:29:09.483484+0000","last_became_active":"2024-08-17T02:29:09.475796+0000","last_became_peered":"2024-08-17T02:29:09.475796+0000","last_unstale":"2024-08-17T02:29:09.483484+0000","last_undegraded":"2024-08-17T02:29:09.483484+0000","last_fullsized":"2024-08-17T02:29:09.483484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.793675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.506084+0000","last_change":"2024-08-17T02:29:08.476918+0000","last_active":"2024-08-17T02:29:09.506084+0000","last_peered":"2024-08-17T02:29:09.506084+0000","last_clean":"2024-08-17T02:29:09.506084+0000","last_became_active":"2024-08-17T02:29:08.476398+0000","last_became_peered":"2024-08-17T02:29:08.476398+0000","last_unstale":"2024-08-17T02:29:09.506084+0000","last_undegraded":"2024-08-17T02:29:09.506084+0000","last_fullsized":"2024-08-17T02:29:09.506084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503892+0000","last_change":"2024-08-17T02:29:09.502218+0000","last_active":"2024-08-17T02:29:09.503892+0000","last_peered":"2024-08-17T02:29:09.503892+0000","last_clean":"2024-08-17T02:29:09.503892+0000","last_became_active":"2024-08-17T02:29:09.495867+0000","last_became_peered":"2024-08-17T02:29:09.495867+0000","last_unstale":"2024-08-17T02:29:09.503892+0000","last_undegraded":"2024-08-17T02:29:09.503892+0000","last_fullsized":"2024-08-17T02:29:09.503892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500523+0000","last_change":"2024-08-17T02:29:08.456255+0000","last_active":"2024-08-17T02:29:09.500523+0000","last_peered":"2024-08-17T02:29:09.500523+0000","last_clean":"2024-08-17T02:29:09.500523+0000","last_became_active":"2024-08-17T02:29:08.455951+0000","last_became_peered":"2024-08-17T02:29:08.455951+0000","last_unstale":"2024-08-17T02:29:09.500523+0000","last_undegraded":"2024-08-17T02:29:09.500523+0000","last_fullsized":"2024-08-17T02:29:09.500523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494299+0000","last_change":"2024-08-17T02:29:09.491084+0000","last_active":"2024-08-17T02:29:09.494299+0000","last_peered":"2024-08-17T02:29:09.494299+0000","last_clean":"2024-08-17T02:29:09.494299+0000","last_became_active":"2024-08-17T02:29:09.486223+0000","last_became_peered":"2024-08-17T02:29:09.486223+0000","last_unstale":"2024-08-17T02:29:09.494299+0000","last_undegraded":"2024-08-17T02:29:09.494299+0000","last_fullsized":"2024-08-17T02:29:09.494299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488081+0000","last_change":"2024-08-17T02:29:08.472582+0000","last_active":"2024-08-17T02:29:09.488081+0000","last_peered":"2024-08-17T02:29:09.488081+0000","last_clean":"2024-08-17T02:29:09.488081+0000","last_became_active":"2024-08-17T02:29:08.472353+0000","last_became_peered":"2024-08-17T02:29:08.472353+0000","last_unstale":"2024-08-17T02:29:09.488081+0000","last_undegraded":"2024-08-17T02:29:09.488081+0000","last_fullsized":"2024-08-17T02:29:09.488081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503846+0000","last_change":"2024-08-17T02:29:09.492684+0000","last_active":"2024-08-17T02:29:09.503846+0000","last_peered":"2024-08-17T02:29:09.503846+0000","last_clean":"2024-08-17T02:29:09.503846+0000","last_became_active":"2024-08-17T02:29:09.492444+0000","last_became_peered":"2024-08-17T02:29:09.492444+0000","last_unstale":"2024-08-17T02:29:09.503846+0000","last_undegraded":"2024-08-17T02:29:09.503846+0000","last_fullsized":"2024-08-17T02:29:09.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470244+0000","last_change":"2024-08-17T02:29:08.475729+0000","last_active":"2024-08-17T02:29:09.470244+0000","last_peered":"2024-08-17T02:29:09.470244+0000","last_clean":"2024-08-17T02:29:09.470244+0000","last_became_active":"2024-08-17T02:29:08.475476+0000","last_became_peered":"2024-08-17T02:29:08.475476+0000","last_unstale":"2024-08-17T02:29:09.470244+0000","last_undegraded":"2024-08-17T02:29:09.470244+0000","last_fullsized":"2024-08-17T02:29:09.470244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487181+0000","last_change":"2024-08-17T02:29:09.475265+0000","last_active":"2024-08-17T02:29:09.487181+0000","last_peered":"2024-08-17T02:29:09.487181+0000","last_clean":"2024-08-17T02:29:09.487181+0000","last_became_active":"2024-08-17T02:29:09.474621+0000","last_became_peered":"2024-08-17T02:29:09.474621+0000","last_unstale":"2024-08-17T02:29:09.487181+0000","last_undegraded":"2024-08-17T02:29:09.487181+0000","last_fullsized":"2024-08-17T02:29:09.487181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496446+0000","last_change":"2024-08-17T02:29:08.461859+0000","last_active":"2024-08-17T02:29:09.496446+0000","last_peered":"2024-08-17T02:29:09.496446+0000","last_clean":"2024-08-17T02:29:09.496446+0000","last_became_active":"2024-08-17T02:29:08.461535+0000","last_became_peered":"2024-08-17T02:29:08.461535+0000","last_unstale":"2024-08-17T02:29:09.496446+0000","last_undegraded":"2024-08-17T02:29:09.496446+0000","last_fullsized":"2024-08-17T02:29:09.496446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501548+0000","last_change":"2024-08-17T02:29:09.491129+0000","last_active":"2024-08-17T02:29:09.501548+0000","last_peered":"2024-08-17T02:29:09.501548+0000","last_clean":"2024-08-17T02:29:09.501548+0000","last_became_active":"2024-08-17T02:29:09.490847+0000","last_became_peered":"2024-08-17T02:29:09.490847+0000","last_unstale":"2024-08-17T02:29:09.501548+0000","last_undegraded":"2024-08-17T02:29:09.501548+0000","last_fullsized":"2024-08-17T02:29:09.501548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496485+0000","last_change":"2024-08-17T02:29:08.457588+0000","last_active":"2024-08-17T02:29:09.496485+0000","last_peered":"2024-08-17T02:29:09.496485+0000","last_clean":"2024-08-17T02:29:09.496485+0000","last_became_active":"2024-08-17T02:29:08.457346+0000","last_became_peered":"2024-08-17T02:29:08.457346+0000","last_unstale":"2024-08-17T02:29:09.496485+0000","last_undegraded":"2024-08-17T02:29:09.496485+0000","last_fullsized":"2024-08-17T02:29:09.496485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:08.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502379+0000","last_change":"2024-08-17T02:29:09.494028+0000","last_active":"2024-08-17T02:29:09.502379+0000","last_peered":"2024-08-17T02:29:09.502379+0000","last_clean":"2024-08-17T02:29:09.502379+0000","last_became_active":"2024-08-17T02:29:09.493737+0000","last_became_peered":"2024-08-17T02:29:09.493737+0000","last_unstale":"2024-08-17T02:29:09.502379+0000","last_undegraded":"2024-08-17T02:29:09.502379+0000","last_fullsized":"2024-08-17T02:29:09.502379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.491687+0000","last_change":"2024-08-17T02:29:08.466598+0000","last_active":"2024-08-17T02:29:09.491687+0000","last_peered":"2024-08-17T02:29:09.491687+0000","last_clean":"2024-08-17T02:29:09.491687+0000","last_became_active":"2024-08-17T02:29:08.466312+0000","last_became_peered":"2024-08-17T02:29:08.466312+0000","last_unstale":"2024-08-17T02:29:09.491687+0000","last_undegraded":"2024-08-17T02:29:09.491687+0000","last_fullsized":"2024-08-17T02:29:09.491687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504407+0000","last_change":"2024-08-17T02:29:09.503142+0000","last_active":"2024-08-17T02:29:09.504407+0000","last_peered":"2024-08-17T02:29:09.504407+0000","last_clean":"2024-08-17T02:29:09.504407+0000","last_became_active":"2024-08-17T02:29:09.500631+0000","last_became_peered":"2024-08-17T02:29:09.500631+0000","last_unstale":"2024-08-17T02:29:09.504407+0000","last_undegraded":"2024-08-17T02:29:09.504407+0000","last_fullsized":"2024-08-17T02:29:09.504407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496744+0000","last_change":"2024-08-17T02:29:08.461264+0000","last_active":"2024-08-17T02:29:09.496744+0000","last_peered":"2024-08-17T02:29:09.496744+0000","last_clean":"2024-08-17T02:29:09.496744+0000","last_became_active":"2024-08-17T02:29:08.460980+0000","last_became_peered":"2024-08-17T02:29:08.460980+0000","last_unstale":"2024-08-17T02:29:09.496744+0000","last_undegraded":"2024-08-17T02:29:09.496744+0000","last_fullsized":"2024-08-17T02:29:09.496744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494761+0000","last_change":"2024-08-17T02:29:09.491641+0000","last_active":"2024-08-17T02:29:09.494761+0000","last_peered":"2024-08-17T02:29:09.494761+0000","last_clean":"2024-08-17T02:29:09.494761+0000","last_became_active":"2024-08-17T02:29:09.491430+0000","last_became_peered":"2024-08-17T02:29:09.491430+0000","last_unstale":"2024-08-17T02:29:09.494761+0000","last_undegraded":"2024-08-17T02:29:09.494761+0000","last_fullsized":"2024-08-17T02:29:09.494761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466879+0000","last_change":"2024-08-17T02:29:08.471744+0000","last_active":"2024-08-17T02:29:09.466879+0000","last_peered":"2024-08-17T02:29:09.466879+0000","last_clean":"2024-08-17T02:29:09.466879+0000","last_became_active":"2024-08-17T02:29:08.471449+0000","last_became_peered":"2024-08-17T02:29:08.471449+0000","last_unstale":"2024-08-17T02:29:09.466879+0000","last_undegraded":"2024-08-17T02:29:09.466879+0000","last_fullsized":"2024-08-17T02:29:09.466879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504380+0000","last_change":"2024-08-17T02:29:09.502714+0000","last_active":"2024-08-17T02:29:09.504380+0000","last_peered":"2024-08-17T02:29:09.504380+0000","last_clean":"2024-08-17T02:29:09.504380+0000","last_became_active":"2024-08-17T02:29:09.502509+0000","last_became_peered":"2024-08-17T02:29:09.502509+0000","last_unstale":"2024-08-17T02:29:09.504380+0000","last_undegraded":"2024-08-17T02:29:09.504380+0000","last_fullsized":"2024-08-17T02:29:09.504380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:11.241240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475314+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:09.475314+0000","last_peered":"2024-08-17T02:29:09.475314+0000","last_clean":"2024-08-17T02:29:09.475314+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:09.475314+0000","last_undegraded":"2024-08-17T02:29:09.475314+0000","last_fullsized":"2024-08-17T02:29:09.475314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472401+0000","last_change":"2024-08-17T02:29:08.460254+0000","last_active":"2024-08-17T02:29:09.472401+0000","last_peered":"2024-08-17T02:29:09.472401+0000","last_clean":"2024-08-17T02:29:09.472401+0000","last_became_active":"2024-08-17T02:29:08.459985+0000","last_became_peered":"2024-08-17T02:29:08.459985+0000","last_unstale":"2024-08-17T02:29:09.472401+0000","last_undegraded":"2024-08-17T02:29:09.472401+0000","last_fullsized":"2024-08-17T02:29:09.472401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499667+0000","last_change":"2024-08-17T02:29:09.498589+0000","last_active":"2024-08-17T02:29:09.499667+0000","last_peered":"2024-08-17T02:29:09.499667+0000","last_clean":"2024-08-17T02:29:09.499667+0000","last_became_active":"2024-08-17T02:29:09.498056+0000","last_became_peered":"2024-08-17T02:29:09.498056+0000","last_unstale":"2024-08-17T02:29:09.499667+0000","last_undegraded":"2024-08-17T02:29:09.499667+0000","last_fullsized":"2024-08-17T02:29:09.499667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475226+0000","last_change":"2024-08-17T02:29:08.470766+0000","last_active":"2024-08-17T02:29:09.475226+0000","last_peered":"2024-08-17T02:29:09.475226+0000","last_clean":"2024-08-17T02:29:09.475226+0000","last_became_active":"2024-08-17T02:29:08.470301+0000","last_became_peered":"2024-08-17T02:29:08.470301+0000","last_unstale":"2024-08-17T02:29:09.475226+0000","last_undegraded":"2024-08-17T02:29:09.475226+0000","last_fullsized":"2024-08-17T02:29:09.475226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472473+0000","last_change":"2024-08-17T02:29:09.465345+0000","last_active":"2024-08-17T02:29:09.472473+0000","last_peered":"2024-08-17T02:29:09.472473+0000","last_clean":"2024-08-17T02:29:09.472473+0000","last_became_active":"2024-08-17T02:29:09.465075+0000","last_became_peered":"2024-08-17T02:29:09.465075+0000","last_unstale":"2024-08-17T02:29:09.472473+0000","last_undegraded":"2024-08-17T02:29:09.472473+0000","last_fullsized":"2024-08-17T02:29:09.472473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466876+0000","last_change":"2024-08-17T02:29:08.473928+0000","last_active":"2024-08-17T02:29:09.466876+0000","last_peered":"2024-08-17T02:29:09.466876+0000","last_clean":"2024-08-17T02:29:09.466876+0000","last_became_active":"2024-08-17T02:29:08.473189+0000","last_became_peered":"2024-08-17T02:29:08.473189+0000","last_unstale":"2024-08-17T02:29:09.466876+0000","last_undegraded":"2024-08-17T02:29:09.466876+0000","last_fullsized":"2024-08-17T02:29:09.466876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.479531+0000","last_change":"2024-08-17T02:29:09.477076+0000","last_active":"2024-08-17T02:29:09.479531+0000","last_peered":"2024-08-17T02:29:09.479531+0000","last_clean":"2024-08-17T02:29:09.479531+0000","last_became_active":"2024-08-17T02:29:09.476789+0000","last_became_peered":"2024-08-17T02:29:09.476789+0000","last_unstale":"2024-08-17T02:29:09.479531+0000","last_undegraded":"2024-08-17T02:29:09.479531+0000","last_fullsized":"2024-08-17T02:29:09.479531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488186+0000","last_change":"2024-08-17T02:29:08.472166+0000","last_active":"2024-08-17T02:29:09.488186+0000","last_peered":"2024-08-17T02:29:09.488186+0000","last_clean":"2024-08-17T02:29:09.488186+0000","last_became_active":"2024-08-17T02:29:08.471933+0000","last_became_peered":"2024-08-17T02:29:08.471933+0000","last_unstale":"2024-08-17T02:29:09.488186+0000","last_undegraded":"2024-08-17T02:29:09.488186+0000","last_fullsized":"2024-08-17T02:29:09.488186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484642+0000","last_change":"2024-08-17T02:29:09.478904+0000","last_active":"2024-08-17T02:29:09.484642+0000","last_peered":"2024-08-17T02:29:09.484642+0000","last_clean":"2024-08-17T02:29:09.484642+0000","last_became_active":"2024-08-17T02:29:09.476164+0000","last_became_peered":"2024-08-17T02:29:09.476164+0000","last_unstale":"2024-08-17T02:29:09.484642+0000","last_undegraded":"2024-08-17T02:29:09.484642+0000","last_fullsized":"2024-08-17T02:29:09.484642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:06.838621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474425+0000","last_change":"2024-08-17T02:29:08.461319+0000","last_active":"2024-08-17T02:29:09.474425+0000","last_peered":"2024-08-17T02:29:09.474425+0000","last_clean":"2024-08-17T02:29:09.474425+0000","last_became_active":"2024-08-17T02:29:08.460994+0000","last_became_peered":"2024-08-17T02:29:08.460994+0000","last_unstale":"2024-08-17T02:29:09.474425+0000","last_undegraded":"2024-08-17T02:29:09.474425+0000","last_fullsized":"2024-08-17T02:29:09.474425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501176+0000","last_change":"2024-08-17T02:29:09.498026+0000","last_active":"2024-08-17T02:29:09.501176+0000","last_peered":"2024-08-17T02:29:09.501176+0000","last_clean":"2024-08-17T02:29:09.501176+0000","last_became_active":"2024-08-17T02:29:09.497741+0000","last_became_peered":"2024-08-17T02:29:09.497741+0000","last_unstale":"2024-08-17T02:29:09.501176+0000","last_undegraded":"2024-08-17T02:29:09.501176+0000","last_fullsized":"2024-08-17T02:29:09.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484472+0000","last_change":"2024-08-17T02:29:08.471249+0000","last_active":"2024-08-17T02:29:09.484472+0000","last_peered":"2024-08-17T02:29:09.484472+0000","last_clean":"2024-08-17T02:29:09.484472+0000","last_became_active":"2024-08-17T02:29:08.470658+0000","last_became_peered":"2024-08-17T02:29:08.470658+0000","last_unstale":"2024-08-17T02:29:09.484472+0000","last_undegraded":"2024-08-17T02:29:09.484472+0000","last_fullsized":"2024-08-17T02:29:09.484472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477525+0000","last_change":"2024-08-17T02:29:09.475433+0000","last_active":"2024-08-17T02:29:09.477525+0000","last_peered":"2024-08-17T02:29:09.477525+0000","last_clean":"2024-08-17T02:29:09.477525+0000","last_became_active":"2024-08-17T02:29:09.475166+0000","last_became_peered":"2024-08-17T02:29:09.475166+0000","last_unstale":"2024-08-17T02:29:09.477525+0000","last_undegraded":"2024-08-17T02:29:09.477525+0000","last_fullsized":"2024-08-17T02:29:09.477525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474975+0000","last_change":"2024-08-17T02:29:08.473436+0000","last_active":"2024-08-17T02:29:09.474975+0000","last_peered":"2024-08-17T02:29:09.474975+0000","last_clean":"2024-08-17T02:29:09.474975+0000","last_became_active":"2024-08-17T02:29:08.473221+0000","last_became_peered":"2024-08-17T02:29:08.473221+0000","last_unstale":"2024-08-17T02:29:09.474975+0000","last_undegraded":"2024-08-17T02:29:09.474975+0000","last_fullsized":"2024-08-17T02:29:09.474975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483637+0000","last_change":"2024-08-17T02:29:09.480720+0000","last_active":"2024-08-17T02:29:09.483637+0000","last_peered":"2024-08-17T02:29:09.483637+0000","last_clean":"2024-08-17T02:29:09.483637+0000","last_became_active":"2024-08-17T02:29:09.480335+0000","last_became_peered":"2024-08-17T02:29:09.480335+0000","last_unstale":"2024-08-17T02:29:09.483637+0000","last_undegraded":"2024-08-17T02:29:09.483637+0000","last_fullsized":"2024-08-17T02:29:09.483637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504904+0000","last_change":"2024-08-17T02:29:08.473608+0000","last_active":"2024-08-17T02:29:09.504904+0000","last_peered":"2024-08-17T02:29:09.504904+0000","last_clean":"2024-08-17T02:29:09.504904+0000","last_became_active":"2024-08-17T02:29:08.473188+0000","last_became_peered":"2024-08-17T02:29:08.473188+0000","last_unstale":"2024-08-17T02:29:09.504904+0000","last_undegraded":"2024-08-17T02:29:09.504904+0000","last_fullsized":"2024-08-17T02:29:09.504904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494131+0000","last_change":"2024-08-17T02:29:09.488891+0000","last_active":"2024-08-17T02:29:09.494131+0000","last_peered":"2024-08-17T02:29:09.494131+0000","last_clean":"2024-08-17T02:29:09.494131+0000","last_became_active":"2024-08-17T02:29:09.486565+0000","last_became_peered":"2024-08-17T02:29:09.486565+0000","last_unstale":"2024-08-17T02:29:09.494131+0000","last_undegraded":"2024-08-17T02:29:09.494131+0000","last_fullsized":"2024-08-17T02:29:09.494131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475125+0000","last_change":"2024-08-17T02:29:08.470705+0000","last_active":"2024-08-17T02:29:09.475125+0000","last_peered":"2024-08-17T02:29:09.475125+0000","last_clean":"2024-08-17T02:29:09.475125+0000","last_became_active":"2024-08-17T02:29:08.469956+0000","last_became_peered":"2024-08-17T02:29:08.469956+0000","last_unstale":"2024-08-17T02:29:09.475125+0000","last_undegraded":"2024-08-17T02:29:09.475125+0000","last_fullsized":"2024-08-17T02:29:09.475125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481784+0000","last_change":"2024-08-17T02:29:09.473933+0000","last_active":"2024-08-17T02:29:09.481784+0000","last_peered":"2024-08-17T02:29:09.481784+0000","last_clean":"2024-08-17T02:29:09.481784+0000","last_became_active":"2024-08-17T02:29:09.473044+0000","last_became_peered":"2024-08-17T02:29:09.473044+0000","last_unstale":"2024-08-17T02:29:09.481784+0000","last_undegraded":"2024-08-17T02:29:09.481784+0000","last_fullsized":"2024-08-17T02:29:09.481784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.880794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473548+0000","last_change":"2024-08-17T02:29:08.470009+0000","last_active":"2024-08-17T02:29:09.473548+0000","last_peered":"2024-08-17T02:29:09.473548+0000","last_clean":"2024-08-17T02:29:09.473548+0000","last_became_active":"2024-08-17T02:29:08.469646+0000","last_became_peered":"2024-08-17T02:29:08.469646+0000","last_unstale":"2024-08-17T02:29:09.473548+0000","last_undegraded":"2024-08-17T02:29:09.473548+0000","last_fullsized":"2024-08-17T02:29:09.473548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483992+0000","last_change":"2024-08-17T02:29:09.481399+0000","last_active":"2024-08-17T02:29:09.483992+0000","last_peered":"2024-08-17T02:29:09.483992+0000","last_clean":"2024-08-17T02:29:09.483992+0000","last_became_active":"2024-08-17T02:29:09.481104+0000","last_became_peered":"2024-08-17T02:29:09.481104+0000","last_unstale":"2024-08-17T02:29:09.483992+0000","last_undegraded":"2024-08-17T02:29:09.483992+0000","last_fullsized":"2024-08-17T02:29:09.483992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473744+0000","last_change":"2024-08-17T02:29:08.468611+0000","last_active":"2024-08-17T02:29:09.473744+0000","last_peered":"2024-08-17T02:29:09.473744+0000","last_clean":"2024-08-17T02:29:09.473744+0000","last_became_active":"2024-08-17T02:29:08.468075+0000","last_became_peered":"2024-08-17T02:29:08.468075+0000","last_unstale":"2024-08-17T02:29:09.473744+0000","last_undegraded":"2024-08-17T02:29:09.473744+0000","last_fullsized":"2024-08-17T02:29:09.473744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483055+0000","last_change":"2024-08-17T02:29:09.474989+0000","last_active":"2024-08-17T02:29:09.483055+0000","last_peered":"2024-08-17T02:29:09.483055+0000","last_clean":"2024-08-17T02:29:09.483055+0000","last_became_active":"2024-08-17T02:29:09.474717+0000","last_became_peered":"2024-08-17T02:29:09.474717+0000","last_unstale":"2024-08-17T02:29:09.483055+0000","last_undegraded":"2024-08-17T02:29:09.483055+0000","last_fullsized":"2024-08-17T02:29:09.483055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494182+0000","last_change":"2024-08-17T02:29:08.474152+0000","last_active":"2024-08-17T02:29:09.494182+0000","last_peered":"2024-08-17T02:29:09.494182+0000","last_clean":"2024-08-17T02:29:09.494182+0000","last_became_active":"2024-08-17T02:29:08.473850+0000","last_became_peered":"2024-08-17T02:29:08.473850+0000","last_unstale":"2024-08-17T02:29:09.494182+0000","last_undegraded":"2024-08-17T02:29:09.494182+0000","last_fullsized":"2024-08-17T02:29:09.494182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489628+0000","last_change":"2024-08-17T02:29:09.480093+0000","last_active":"2024-08-17T02:29:09.489628+0000","last_peered":"2024-08-17T02:29:09.489628+0000","last_clean":"2024-08-17T02:29:09.489628+0000","last_became_active":"2024-08-17T02:29:09.472172+0000","last_became_peered":"2024-08-17T02:29:09.472172+0000","last_unstale":"2024-08-17T02:29:09.489628+0000","last_undegraded":"2024-08-17T02:29:09.489628+0000","last_fullsized":"2024-08-17T02:29:09.489628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499201+0000","last_change":"2024-08-17T02:29:09.494902+0000","last_active":"2024-08-17T02:29:09.499201+0000","last_peered":"2024-08-17T02:29:09.499201+0000","last_clean":"2024-08-17T02:29:09.499201+0000","last_became_active":"2024-08-17T02:29:09.491782+0000","last_became_peered":"2024-08-17T02:29:09.491782+0000","last_unstale":"2024-08-17T02:29:09.499201+0000","last_undegraded":"2024-08-17T02:29:09.499201+0000","last_fullsized":"2024-08-17T02:29:09.499201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502069+0000","last_change":"2024-08-17T02:29:08.475348+0000","last_active":"2024-08-17T02:29:09.502069+0000","last_peered":"2024-08-17T02:29:09.502069+0000","last_clean":"2024-08-17T02:29:09.502069+0000","last_became_active":"2024-08-17T02:29:08.475111+0000","last_became_peered":"2024-08-17T02:29:08.475111+0000","last_unstale":"2024-08-17T02:29:09.502069+0000","last_undegraded":"2024-08-17T02:29:09.502069+0000","last_fullsized":"2024-08-17T02:29:09.502069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:21:10.249183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.497333+0000","last_change":"2024-08-17T02:29:09.492777+0000","last_active":"2024-08-17T02:29:09.497333+0000","last_peered":"2024-08-17T02:29:09.497333+0000","last_clean":"2024-08-17T02:29:09.497333+0000","last_became_active":"2024-08-17T02:29:09.492531+0000","last_became_peered":"2024-08-17T02:29:09.492531+0000","last_unstale":"2024-08-17T02:29:09.497333+0000","last_undegraded":"2024-08-17T02:29:09.497333+0000","last_fullsized":"2024-08-17T02:29:09.497333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502308+0000","last_change":"2024-08-17T02:29:08.473691+0000","last_active":"2024-08-17T02:29:09.502308+0000","last_peered":"2024-08-17T02:29:09.502308+0000","last_clean":"2024-08-17T02:29:09.502308+0000","last_became_active":"2024-08-17T02:29:08.473411+0000","last_became_peered":"2024-08-17T02:29:08.473411+0000","last_unstale":"2024-08-17T02:29:09.502308+0000","last_undegraded":"2024-08-17T02:29:09.502308+0000","last_fullsized":"2024-08-17T02:29:09.502308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494186+0000","last_change":"2024-08-17T02:29:09.492743+0000","last_active":"2024-08-17T02:29:09.494186+0000","last_peered":"2024-08-17T02:29:09.494186+0000","last_clean":"2024-08-17T02:29:09.494186+0000","last_became_active":"2024-08-17T02:29:09.492489+0000","last_became_peered":"2024-08-17T02:29:09.492489+0000","last_unstale":"2024-08-17T02:29:09.494186+0000","last_undegraded":"2024-08-17T02:29:09.494186+0000","last_fullsized":"2024-08-17T02:29:09.494186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494368+0000","last_change":"2024-08-17T02:29:08.462205+0000","last_active":"2024-08-17T02:29:09.494368+0000","last_peered":"2024-08-17T02:29:09.494368+0000","last_clean":"2024-08-17T02:29:09.494368+0000","last_became_active":"2024-08-17T02:29:08.461965+0000","last_became_peered":"2024-08-17T02:29:08.461965+0000","last_unstale":"2024-08-17T02:29:09.494368+0000","last_undegraded":"2024-08-17T02:29:09.494368+0000","last_fullsized":"2024-08-17T02:29:09.494368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489475+0000","last_change":"2024-08-17T02:29:09.481257+0000","last_active":"2024-08-17T02:29:09.489475+0000","last_peered":"2024-08-17T02:29:09.489475+0000","last_clean":"2024-08-17T02:29:09.489475+0000","last_became_active":"2024-08-17T02:29:09.480977+0000","last_became_peered":"2024-08-17T02:29:09.480977+0000","last_unstale":"2024-08-17T02:29:09.489475+0000","last_undegraded":"2024-08-17T02:29:09.489475+0000","last_fullsized":"2024-08-17T02:29:09.489475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503649+0000","last_change":"2024-08-17T02:29:08.459843+0000","last_active":"2024-08-17T02:29:09.503649+0000","last_peered":"2024-08-17T02:29:09.503649+0000","last_clean":"2024-08-17T02:29:09.503649+0000","last_became_active":"2024-08-17T02:29:08.459311+0000","last_became_peered":"2024-08-17T02:29:08.459311+0000","last_unstale":"2024-08-17T02:29:09.503649+0000","last_undegraded":"2024-08-17T02:29:09.503649+0000","last_fullsized":"2024-08-17T02:29:09.503649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:14.102117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":811008,"data_stored":663246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":72308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":819200,"data_stored":663302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:14.015 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:29:14.015 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:29:14.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:29:14.016 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:29:14.016 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:29:14.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.217+0000 7fa168000640 1 Processor -- start 2024-08-17T02:29:14.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.217+0000 7fa168000640 1 -- start start 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.218+0000 7fa168000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 0x7fa1600aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.218+0000 7fa168000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600afb50 con 0x7fa160158cb0 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.218+0000 7fa168000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600abc80 con 0x7fa1600af6d0 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.218+0000 7fa168000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600aae50 con 0x7fa16015a090 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.218+0000 7fa165600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa160158cb0 0x7fa1600ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41308/0 (socket says 172.21.15.110:41308) 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa165600640 1 -- 172.21.15.110:0/4193882556 learned_addr learned my addr 172.21.15.110:0/4193882556 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:14.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa166000640 1 --2- 172.21.15.110:0/4193882556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 0x7fa1600aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774108134 0 0) 0x7fa154001110 con 0x7fa160158cb0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1480034e0 con 0x7fa160158cb0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2811373074 0 0) 0x7fa1600abc80 con 0x7fa1600af6d0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa154001110 con 0x7fa1600af6d0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2623240222 0 0) 0x7fa1480034e0 con 0x7fa160158cb0 2024-08-17T02:29:14.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa166000640 1 -- 172.21.15.110:0/4193882556 >> v1:172.21.15.177:6789/0 conn(0x7fa1600af6d0 legacy=0x7fa1600ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa166000640 1 -- 172.21.15.110:0/4193882556 >> v1:172.21.15.110:6789/0 conn(0x7fa160158cb0 legacy=0x7fa1600ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.219+0000 7fa166000640 1 -- 172.21.15.110:0/4193882556 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600ab070 con 0x7fa16015a090 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.220+0000 7fa166000640 1 --2- 172.21.15.110:0/4193882556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 0x7fa1600aa910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e90 tx=0x7fa158009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a86ee960717e915b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154001620 con 0x7fa16015a090 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15802d050 con 0x7fa16015a090 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa15fe00640 1 -- 172.21.15.110:0/4193882556 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158031630 con 0x7fa16015a090 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 -- 172.21.15.110:0/4193882556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 msgr2=0x7fa1600aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 --2- 172.21.15.110:0/4193882556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 0x7fa1600aa910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e90 tx=0x7fa158009780 comp rx=0 tx=0).stop 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 -- 172.21.15.110:0/4193882556 shutdown_connections 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 --2- 172.21.15.110:0/4193882556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa16015a090 0x7fa1600aa910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 -- 172.21.15.110:0/4193882556 >> 172.21.15.110:0/4193882556 conn(0x7fa160096a70 msgr2=0x7fa160096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 -- 172.21.15.110:0/4193882556 shutdown_connections 2024-08-17T02:29:14.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.221+0000 7fa168000640 1 -- 172.21.15.110:0/4193882556 wait complete. 2024-08-17T02:29:14.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.223+0000 7fa168000640 1 Processor -- start 2024-08-17T02:29:14.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.223+0000 7fa168000640 1 -- start start 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.223+0000 7fa168000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 0x7fa160154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.223+0000 7fa168000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa160158cb0 0x7fa160151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.223+0000 7fa168000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa168000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16016d860 con 0x7fa16015a090 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa168000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16016cce0 con 0x7fa160158cb0 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa168000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16016cfc0 con 0x7fa1600af6d0 2024-08-17T02:29:14.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48780/0 (socket says 172.21.15.110:48780) 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 -- 172.21.15.110:0/1471610913 learned_addr learned my addr 172.21.15.110:0/1471610913 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa165600640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 0x7fa160154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa164c00640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa160158cb0 0x7fa160151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 -- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 msgr2=0x7fa160154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 0x7fa160154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 -- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa160158cb0 msgr2=0x7fa160151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa160158cb0 0x7fa160151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 -- 172.21.15.110:0/1471610913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa158009a20 con 0x7fa16015a090 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa165600640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 0x7fa160154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:14.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.224+0000 7fa166000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e90 tx=0x7fa158037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.225+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15803ba70 con 0x7fa16015a090 2024-08-17T02:29:14.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.225+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158040070 con 0x7fa16015a090 2024-08-17T02:29:14.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.225+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15803be40 con 0x7fa16015a090 2024-08-17T02:29:14.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.225+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16016d2a0 con 0x7fa16015a090 2024-08-17T02:29:14.227 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.225+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16016c920 con 0x7fa16015a090 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.226+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa160064db0 con 0x7fa16015a090 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.226+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa15803c420 con 0x7fa16015a090 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.227+0000 7fa15cc00640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 0x7fa140067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.227+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa158042070 con 0x7fa16015a090 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.228+0000 7fa165600640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 0x7fa140067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.228+0000 7fa165600640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 0x7fa140067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1540010e0 tx=0x7fa154000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.231+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa158071d90 con 0x7fa16015a090 2024-08-17T02:29:14.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.444+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa1600ad640 con 0x7fa16015a090 2024-08-17T02:29:14.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.447+0000 7fa15cc00640 1 -- 172.21.15.110:0/1471610913 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161034 (secure 0 0 0) 0x7fa15804c090 con 0x7fa16015a090 2024-08-17T02:29:14.449 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.449+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 msgr2=0x7fa140067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.449+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 0x7fa140067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa1540010e0 tx=0x7fa154000bc0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.449+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 msgr2=0x7fa160168740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.449+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa158009e90 tx=0x7fa158037000 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 shutdown_connections 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa140065150 0x7fa140067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa16015a090 0x7fa160168740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa160158cb0 0x7fa160151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 --2- 172.21.15.110:0/1471610913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1600af6d0 0x7fa160154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 >> 172.21.15.110:0/1471610913 conn(0x7fa160096a70 msgr2=0x7fa1600698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 shutdown_connections 2024-08-17T02:29:14.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.450+0000 7fa168000640 1 -- 172.21.15.110:0/1471610913 wait complete. 2024-08-17T02:29:14.465 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":36835},{"type":"v1","addr":"172.21.15.110:6833","nonce":36835}]},"active_addr":"172.21.15.110:6833/36835","active_change":"2024-08-17T02:28:55.420900+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3639204045}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":77364758}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":788886045}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":706937459}]}]} 2024-08-17T02:29:14.468 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:29:14.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:29:14.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:14.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.615+0000 7f3942e00640 1 Processor -- start 2024-08-17T02:29:14.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.615+0000 7f3942e00640 1 -- start start 2024-08-17T02:29:14.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.616+0000 7f3942e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f393c158bd0 0x7f393c069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.616+0000 7f3942e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f393c069540 0x7f393c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.616+0000 7f3942e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f393c0aec20 con 0x7f393c0ac540 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.616+0000 7f3942e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c0699c0 con 0x7f393c069540 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.616+0000 7f3942e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393c0ae330 con 0x7f393c158bd0 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f393c069540 0x7f393c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3942400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f393c0ac540 0x7f393c067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41324/0 (socket says 172.21.15.110:41324) 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f393c069540 0x7f393c0ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48786/0 (socket says 172.21.15.110:48786) 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3942400640 1 -- 172.21.15.110:0/3924015701 learned_addr learned my addr 172.21.15.110:0/3924015701 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941a00640 1 --2- 172.21.15.110:0/3924015701 >> v2:172.21.15.177:3300/0 conn(0x7f393c158bd0 0x7f393c069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 -- 172.21.15.110:0/3924015701 >> v2:172.21.15.177:3300/0 conn(0x7f393c158bd0 msgr2=0x7f393c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 --2- 172.21.15.110:0/3924015701 >> v2:172.21.15.177:3300/0 conn(0x7f393c158bd0 0x7f393c069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f393be00640 1 -- 172.21.15.110:0/3924015701 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112247059 0 0) 0x7f393c0aec20 con 0x7f393c0ac540 2024-08-17T02:29:14.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 -- 172.21.15.110:0/3924015701 >> v1:172.21.15.110:6789/0 conn(0x7f393c0ac540 legacy=0x7f393c067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.617+0000 7f3941000640 1 -- 172.21.15.110:0/3924015701 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393c0acd30 con 0x7f393c069540 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.618+0000 7f3941000640 1 --2- 172.21.15.110:0/3924015701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0ac000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f393c068dc0 tx=0x7f39280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b65cf13047ed8c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.618+0000 7f393be00640 1 -- 172.21.15.110:0/3924015701 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392802ad20 con 0x7f393c069540 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.618+0000 7f393be00640 1 -- 172.21.15.110:0/3924015701 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392802ae80 con 0x7f393c069540 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.618+0000 7f393be00640 1 -- 172.21.15.110:0/3924015701 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3928032670 con 0x7f393c069540 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 -- 172.21.15.110:0/3924015701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 msgr2=0x7f393c0ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 --2- 172.21.15.110:0/3924015701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0ac000 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f393c068dc0 tx=0x7f39280090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 -- 172.21.15.110:0/3924015701 shutdown_connections 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 --2- 172.21.15.110:0/3924015701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0ac000 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 --2- 172.21.15.110:0/3924015701 >> v2:172.21.15.177:3300/0 conn(0x7f393c158bd0 0x7f393c069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 -- 172.21.15.110:0/3924015701 >> 172.21.15.110:0/3924015701 conn(0x7f393c096a70 msgr2=0x7f393c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 -- 172.21.15.110:0/3924015701 shutdown_connections 2024-08-17T02:29:14.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.619+0000 7f3942e00640 1 -- 172.21.15.110:0/3924015701 wait complete. 2024-08-17T02:29:14.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.620+0000 7f3942e00640 1 Processor -- start 2024-08-17T02:29:14.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 -- start start 2024-08-17T02:29:14.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393c0ac540 0x7f393c0992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f393c158bd0 0x7f393c16c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0cc2f0 con 0x7f393c069540 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c097d00 con 0x7f393c0ac540 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.621+0000 7f3942e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393c0cb6e0 con 0x7f393c158bd0 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48788/0 (socket says 172.21.15.110:48788) 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 -- 172.21.15.110:0/1834758426 learned_addr learned my addr 172.21.15.110:0/1834758426 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941000640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393c0ac540 0x7f393c0992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3942400640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f393c158bd0 0x7f393c16c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 -- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f393c158bd0 msgr2=0x7f393c16c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f393c158bd0 0x7f393c16c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 -- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393c0ac540 msgr2=0x7f393c0992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393c0ac540 0x7f393c0992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 -- 172.21.15.110:0/1834758426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009390 con 0x7f393c069540 2024-08-17T02:29:14.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3941a00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f393000e900 tx=0x7f39300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000c8e0 con 0x7f393c069540 2024-08-17T02:29:14.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000ca40 con 0x7f393c069540 2024-08-17T02:29:14.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cde0 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.622+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c0cb9c0 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.623+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c0cbf80 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.624+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c071050 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.624+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3930013680 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.625+0000 7f3938c00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 0x7f391c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.625+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3930082620 con 0x7f393c069540 2024-08-17T02:29:14.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.625+0000 7f3941000640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 0x7f391c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.626+0000 7f3941000640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 0x7f391c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3928034000 tx=0x7f3928032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.629+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3930050780 con 0x7f393c069540 2024-08-17T02:29:14.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.802+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f393c0ac130 con 0x7f393c069540 2024-08-17T02:29:14.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.803+0000 7f3938c00640 1 -- 172.21.15.110:0/1834758426 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f3930053da0 con 0x7f393c069540 2024-08-17T02:29:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:14.804 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 msgr2=0x7f391c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 0x7f391c067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3928034000 tx=0x7f3928032000 comp rx=0 tx=0).stop 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 msgr2=0x7f393c0977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f393000e900 tx=0x7f39300090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 shutdown_connections 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f391c065150 0x7f391c067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f393c158bd0 0x7f393c16c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f393c0ac540 0x7f393c0992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 --2- 172.21.15.110:0/1834758426 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f393c069540 0x7f393c0977c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 >> 172.21.15.110:0/1834758426 conn(0x7f393c096a70 msgr2=0x7f393c0aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 shutdown_connections 2024-08-17T02:29:14.807 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.805+0000 7f3942e00640 1 -- 172.21.15.110:0/1834758426 wait complete. 2024-08-17T02:29:14.820 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:29:14.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:14.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.967+0000 7f04c6200640 1 Processor -- start 2024-08-17T02:29:14.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.967+0000 7f04c6200640 1 -- start start 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04c0155a20 0x7f04c00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 0x7f04c00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 0x7f04c006dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c00b0350 con 0x7f04c0155a20 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c006e1d0 con 0x7f04c006d7f0 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.968+0000 7f04c6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0156670 con 0x7f04c0155df0 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04c0155a20 0x7f04c00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04c0155a20 0x7f04c00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48796/0 (socket says 172.21.15.110:48796) 2024-08-17T02:29:14.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 -- 172.21.15.110:0/3446579016 learned_addr learned my addr 172.21.15.110:0/3446579016 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:14.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bea00640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 0x7f04c00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 -- 172.21.15.110:0/3446579016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 msgr2=0x7f04c00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:14.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bfe00640 1 --2- 172.21.15.110:0/3446579016 >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 0x7f04c006dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 0x7f04c00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 -- 172.21.15.110:0/3446579016 >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 msgr2=0x7f04c006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 --2- 172.21.15.110:0/3446579016 >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 0x7f04c006dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bf400640 1 -- 172.21.15.110:0/3446579016 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c006e5e0 con 0x7f04c0155a20 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bea00640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 0x7f04c00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.969+0000 7f04bfe00640 1 --2- 172.21.15.110:0/3446579016 >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 0x7f04c006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.970+0000 7f04bf400640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c0155a20 0x7f04c00adf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04c01565e0 tx=0x7f04b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e798cf6425c78e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.970+0000 7f04be000640 1 -- 172.21.15.110:0/3446579016 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b002add0 con 0x7f04c0155a20 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.970+0000 7f04be000640 1 -- 172.21.15.110:0/3446579016 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b0032440 con 0x7f04c0155a20 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.970+0000 7f04be000640 1 -- 172.21.15.110:0/3446579016 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0032820 con 0x7f04c0155a20 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 -- 172.21.15.110:0/3446579016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c0155a20 msgr2=0x7f04c00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c0155a20 0x7f04c00adf10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f04c01565e0 tx=0x7f04b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 -- 172.21.15.110:0/3446579016 shutdown_connections 2024-08-17T02:29:14.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 --2- 172.21.15.110:0/3446579016 >> v2:172.21.15.177:3300/0 conn(0x7f04c006d7f0 0x7f04c006dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155df0 0x7f04c00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 --2- 172.21.15.110:0/3446579016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c0155a20 0x7f04c00adf10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 -- 172.21.15.110:0/3446579016 >> 172.21.15.110:0/3446579016 conn(0x7f04c00cb9b0 msgr2=0x7f04c00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:14.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 -- 172.21.15.110:0/3446579016 shutdown_connections 2024-08-17T02:29:14.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.971+0000 7f04c6200640 1 -- 172.21.15.110:0/3446579016 wait complete. 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.972+0000 7f04c6200640 1 Processor -- start 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.972+0000 7f04c6200640 1 -- start start 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155a20 0x7f04c014a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04c0155df0 0x7f04c0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0149670 con 0x7f04c006d7f0 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0150850 con 0x7f04c0155df0 2024-08-17T02:29:14.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04c6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0150aa0 con 0x7f04c0155a20 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04bf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.973+0000 7f04bf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48810/0 (socket says 172.21.15.110:48810) 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 -- 172.21.15.110:0/1263804048 learned_addr learned my addr 172.21.15.110:0/1263804048 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bea00640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155a20 0x7f04c014a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bfe00640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04c0155df0 0x7f04c0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 -- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155a20 msgr2=0x7f04c014a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155a20 0x7f04c014a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 -- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04c0155df0 msgr2=0x7f04c0156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04c0155df0 0x7f04c0156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 -- 172.21.15.110:0/1263804048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0009450 con 0x7f04c006d7f0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04bf400640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009210 tx=0x7f04b0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0031de0 con 0x7f04c006d7f0 2024-08-17T02:29:14.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b003d420 con 0x7f04c006d7f0 2024-08-17T02:29:14.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b003d7e0 con 0x7f04c006d7f0 2024-08-17T02:29:14.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0150d80 con 0x7f04c006d7f0 2024-08-17T02:29:14.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.974+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c0151340 con 0x7f04c006d7f0 2024-08-17T02:29:14.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.975+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c0151530 con 0x7f04c006d7f0 2024-08-17T02:29:14.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.976+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f04b0039040 con 0x7f04c006d7f0 2024-08-17T02:29:14.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.977+0000 7f04b6a00640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 0x7f04a0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:14.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.977+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04b00a2960 con 0x7f04c006d7f0 2024-08-17T02:29:14.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.977+0000 7f04bea00640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 0x7f04a0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:14.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.978+0000 7f04bea00640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 0x7f04a0067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:14.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:14.981+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f04b0070980 con 0x7f04c006d7f0 2024-08-17T02:29:15.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.154+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04c0064db0 con 0x7f04c006d7f0 2024-08-17T02:29:15.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.155+0000 7f04b6a00640 1 -- 172.21.15.110:0/1263804048 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f04b0042090 con 0x7f04c006d7f0 2024-08-17T02:29:15.155 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:15.156 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 msgr2=0x7f04a0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 0x7f04a0067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04ac006fd0 tx=0x7f04ac008040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 msgr2=0x7f04c015f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f04b0009210 tx=0x7f04b0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 shutdown_connections 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f04a0065150 0x7f04a0067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04c0155df0 0x7f04c0156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04c0155a20 0x7f04c014a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 --2- 172.21.15.110:0/1263804048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04c006d7f0 0x7f04c015f830 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 >> 172.21.15.110:0/1263804048 conn(0x7f04c00cb9b0 msgr2=0x7f04c01545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 shutdown_connections 2024-08-17T02:29:15.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.157+0000 7f04c6200640 1 -- 172.21.15.110:0/1263804048 wait complete. 2024-08-17T02:29:15.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:29:15.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:29:15.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:29:15.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:29:15.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:29:15.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:29:15.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:29:15.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:29:15.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.430+0000 7fd61aa00640 1 Processor -- start 2024-08-17T02:29:15.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.430+0000 7fd61aa00640 1 -- start start 2024-08-17T02:29:15.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.432+0000 7fd61aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd60c054ff0 0x7fd60c037fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.432+0000 7fd61aa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c007a30 con 0x7fd60c038b50 2024-08-17T02:29:15.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.432+0000 7fd61aa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c006e20 con 0x7fd60c0e2020 2024-08-17T02:29:15.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.432+0000 7fd61aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c007100 con 0x7fd60c054ff0 2024-08-17T02:29:15.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.433+0000 7fd613400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd60c038b50 0x7fd60c0378a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41328/0 (socket says 172.21.15.110:41328) 2024-08-17T02:29:15.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.433+0000 7fd613400640 1 -- 172.21.15.110:0/514733321 learned_addr learned my addr 172.21.15.110:0/514733321 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.433+0000 7fd618a00640 1 --2- 172.21.15.110:0/514733321 >> v2:172.21.15.177:3300/0 conn(0x7fd60c054ff0 0x7fd60c037fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645877151 0 0) 0x7fd60c007a30 con 0x7fd60c038b50 2024-08-17T02:29:15.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5fc0034e0 con 0x7fd60c038b50 2024-08-17T02:29:15.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd618a00640 1 -- 172.21.15.110:0/514733321 >> v1:172.21.15.177:6789/0 conn(0x7fd60c0e2020 legacy=0x7fd60c03aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd618a00640 1 -- 172.21.15.110:0/514733321 >> v1:172.21.15.110:6789/0 conn(0x7fd60c038b50 legacy=0x7fd60c0378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909444507 0 0) 0x7fd60c006e20 con 0x7fd60c0e2020 2024-08-17T02:29:15.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.434+0000 7fd618a00640 1 -- 172.21.15.110:0/514733321 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0073e0 con 0x7fd60c054ff0 2024-08-17T02:29:15.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.436+0000 7fd618a00640 1 --2- 172.21.15.110:0/514733321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c054ff0 0x7fd60c037fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd608009850 tx=0x7fd6080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39af039e3b71e5c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.436+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60802ae40 con 0x7fd60c054ff0 2024-08-17T02:29:15.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.437+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd608032440 con 0x7fd60c054ff0 2024-08-17T02:29:15.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.437+0000 7fd612a00640 1 -- 172.21.15.110:0/514733321 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60802ae40 con 0x7fd60c054ff0 2024-08-17T02:29:15.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.438+0000 7fd61aa00640 1 -- 172.21.15.110:0/514733321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c054ff0 msgr2=0x7fd60c037fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.438+0000 7fd61aa00640 1 --2- 172.21.15.110:0/514733321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c054ff0 0x7fd60c037fb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd608009850 tx=0x7fd6080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.438+0000 7fd61aa00640 1 -- 172.21.15.110:0/514733321 shutdown_connections 2024-08-17T02:29:15.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.439+0000 7fd61aa00640 1 --2- 172.21.15.110:0/514733321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c054ff0 0x7fd60c037fb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.439 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.439+0000 7fd61aa00640 1 -- 172.21.15.110:0/514733321 >> 172.21.15.110:0/514733321 conn(0x7fd60c00f050 msgr2=0x7fd60c058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.439+0000 7fd61aa00640 1 -- 172.21.15.110:0/514733321 shutdown_connections 2024-08-17T02:29:15.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.439+0000 7fd61aa00640 1 -- 172.21.15.110:0/514733321 wait complete. 2024-08-17T02:29:15.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.441+0000 7ff47e400640 1 Processor -- start 2024-08-17T02:29:15.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.442+0000 7fd61aa00640 1 Processor -- start 2024-08-17T02:29:15.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.443+0000 7fd61aa00640 1 -- start start 2024-08-17T02:29:15.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.442+0000 7ff47e400640 1 -- start start 2024-08-17T02:29:15.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.443+0000 7fe297e00640 1 Processor -- start 2024-08-17T02:29:15.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.444+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c038b50 0x7fd60c052000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.444+0000 7fe297e00640 1 -- start start 2024-08-17T02:29:15.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7ff47e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.444+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd60c054ff0 0x7fd60c04d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.444+0000 7fd61aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 0x7fd60c0f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd618a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 0x7fd60c0f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd618a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 0x7fd60c0f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48822/0 (socket says 172.21.15.110:48822) 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd618a00640 1 -- 172.21.15.110:0/272041330 learned_addr learned my addr 172.21.15.110:0/272041330 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd613400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd60c054ff0 0x7fd60c04d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd613e00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c038b50 0x7fd60c052000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0f6780 con 0x7fd60c0e2020 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c04e3c0 con 0x7fd60c038b50 2024-08-17T02:29:15.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c04db20 con 0x7fd60c054ff0 2024-08-17T02:29:15.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7ff47e400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4780cea00 0x7ff4780c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7ff47e400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780cb470 con 0x7ff47815c710 2024-08-17T02:29:15.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7ff47e400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4780cc550 con 0x7ff4780cea00 2024-08-17T02:29:15.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.445+0000 7ff47e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780c69f0 con 0x7ff47815c340 2024-08-17T02:29:15.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7ff477e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4780cea00 0x7ff4780c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fe297e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2980cc9d0 0x7fe2980ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fe297e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980cf9d0 con 0x7fe298158c80 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fe297e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980ceb60 con 0x7fe2980cd700 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fe297e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980cedc0 con 0x7fe2980cc9d0 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 -- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c038b50 msgr2=0x7fd60c052000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c038b50 0x7fd60c052000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 -- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 msgr2=0x7fd60c0f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 0x7fd60c0f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.448 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608009390 con 0x7fd60c054ff0 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613e00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd60c038b50 0x7fd60c052000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd618a00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0e2020 0x7fd60c0f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.446+0000 7fd613400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd60c054ff0 0x7fd60c04d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd614000b60 tx=0x7fd614064990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe296a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe298158c80 0x7fe2980cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41332/0 (socket says 172.21.15.110:41332) 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe296a00640 1 -- 172.21.15.110:0/1740433729 learned_addr learned my addr 172.21.15.110:0/1740433729 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7ff477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7ff477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51508/0 (socket says 172.21.15.110:51508) 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7ff477400640 1 -- 172.21.15.110:0/2092776058 learned_addr learned my addr 172.21.15.110:0/2092776058 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630741911 0 0) 0x7fe2980cf9d0 con 0x7fe298158c80 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe27c0034e0 con 0x7fe298158c80 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198503586 0 0) 0x7fe2980ceb60 con 0x7fe2980cd700 2024-08-17T02:29:15.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2980cf9d0 con 0x7fe2980cd700 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.447+0000 7ff476a00640 1 -- 172.21.15.110:0/2092776058 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912612651 0 0) 0x7ff4780cb470 con 0x7ff47815c710 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61406f470 con 0x7fd60c054ff0 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61408f3b0 con 0x7fd60c054ff0 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61408f770 con 0x7fd60c054ff0 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790232690 0 0) 0x7fe2980cf9d0 con 0x7fe2980cd700 2024-08-17T02:29:15.451 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 >> v2:172.21.15.177:3300/0 conn(0x7fe2980cc9d0 msgr2=0x7fe2980ce620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7ff476a00640 1 -- 172.21.15.110:0/2092776058 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c0034e0 con 0x7ff47815c710 2024-08-17T02:29:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c04de00 con 0x7fd60c054ff0 2024-08-17T02:29:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7ff477400640 1 -- 172.21.15.110:0/2092776058 >> v2:172.21.15.177:3300/0 conn(0x7ff4780cea00 msgr2=0x7ff4780c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7ff477400640 1 --2- 172.21.15.110:0/2092776058 >> v2:172.21.15.177:3300/0 conn(0x7ff4780cea00 0x7ff4780c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7ff477400640 1 -- 172.21.15.110:0/2092776058 >> v1:172.21.15.177:6789/0 conn(0x7ff47815c710 legacy=0x7ff4780ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7ff477400640 1 -- 172.21.15.110:0/2092776058 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780cab60 con 0x7ff47815c340 2024-08-17T02:29:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 --2- 172.21.15.110:0/1740433729 >> v2:172.21.15.177:3300/0 conn(0x7fe2980cc9d0 0x7fe2980ce620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.453 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 >> v1:172.21.15.110:6789/0 conn(0x7fe298158c80 legacy=0x7fe2980cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980cf0a0 con 0x7fe2980cd700 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fe280001470 con 0x7fe2980cd700 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 >> v1:172.21.15.177:6789/0 conn(0x7fe2980cd700 legacy=0x7fe2980acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27c004bc0 0x7fe27c004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 0x7fe27c003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c0041f0 0x7fe27c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880015b0 con 0x7fe27c0041f0 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980cedc0 con 0x7fe27c003720 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.448+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c00c250 con 0x7fe27c004bc0 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.449+0000 7fe297400640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c0041f0 0x7fe27c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.449+0000 7fe296000640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 0x7fe27c003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.454 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296a00640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27c004bc0 0x7fe27c004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296000640 1 -- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27c004bc0 msgr2=0x7fe27c004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296000640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe27c004bc0 0x7fe27c004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296000640 1 -- 172.21.15.110:0/1740433729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c0041f0 msgr2=0x7fe27c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c04d800 con 0x7fd60c054ff0 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7f4a19c00640 1 Processor -- start 2024-08-17T02:29:15.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7f4a19c00640 1 -- start start 2024-08-17T02:29:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296000640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c0041f0 0x7fe27c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe296000640 1 -- 172.21.15.110:0/1740433729 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980cf0a0 con 0x7fe27c003720 2024-08-17T02:29:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe297400640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c0041f0 0x7fe27c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.450+0000 7fe297400640 1 -- 172.21.15.110:0/1740433729 reap_dead start 2024-08-17T02:29:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.451+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd61408fba0 con 0x7fd60c054ff0 2024-08-17T02:29:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.452+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd60c059590 con 0x7fd60c054ff0 2024-08-17T02:29:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.452+0000 7f4a19c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a140ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.452+0000 7f4a19c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a140ca8a0 0x7f4a140cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.457 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.452+0000 7ff477400640 1 --2- 172.21.15.110:0/2092776058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff468009f20 tx=0x7ff468009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d36e40d88910f172 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a19c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140cadc0 con 0x7f4a140ccad0 2024-08-17T02:29:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7ff476a00640 1 -- 172.21.15.110:0/2092776058 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468031400 con 0x7ff47815c340 2024-08-17T02:29:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7ff476a00640 1 -- 172.21.15.110:0/2092776058 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46802d050 con 0x7ff47815c340 2024-08-17T02:29:15.458 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7ff476a00640 1 -- 172.21.15.110:0/2092776058 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680317d0 con 0x7ff47815c340 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a19c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a140cd6e0 con 0x7f4a140ca8a0 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a19c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140ccf70 con 0x7f4a14159ca0 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd607400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd5f4065250 0x7fd5f4067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6140f7ef0 con 0x7fd60c054ff0 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd607400640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7fd5f406d460 0x7fd5f406f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5f406ff20 con 0x7fd5f406d460 2024-08-17T02:29:15.459 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6140f9ae0 con 0x7fd60c054ff0 2024-08-17T02:29:15.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a13e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a140ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a13e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a140ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51532/0 (socket says 172.21.15.110:51532) 2024-08-17T02:29:15.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a13e00640 1 -- 172.21.15.110:0/4101428142 learned_addr learned my addr 172.21.15.110:0/4101428142 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fe296000640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 0x7fe27c003b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe2800077a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ab7a96cb4e27a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7f4a13400640 1 --2- 172.21.15.110:0/4101428142 >> v2:172.21.15.177:3300/0 conn(0x7f4a140ca8a0 0x7f4a140cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.453+0000 7fd613e00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd5f4065250 0x7fd5f4067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f59e7800640 1 Processor -- start 2024-08-17T02:29:15.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 -- 172.21.15.110:0/2092776058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 msgr2=0x7ff4780cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.461 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 --2- 172.21.15.110:0/2092776058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff468009f20 tx=0x7ff468009840 comp rx=0 tx=0).stop 2024-08-17T02:29:15.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f59e7800640 1 -- start start 2024-08-17T02:29:15.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f4a13400640 1 -- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 msgr2=0x7f4a140ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f4a13400640 1 --2- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a140ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.462 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f4a12a00640 1 -- 172.21.15.110:0/4101428142 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151995706 0 0) 0x7f4a140cadc0 con 0x7f4a140ccad0 2024-08-17T02:29:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280031400 con 0x7fe27c003720 2024-08-17T02:29:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28002d050 con 0x7fe27c003720 2024-08-17T02:29:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f4a13400640 1 -- 172.21.15.110:0/4101428142 >> v1:172.21.15.177:6789/0 conn(0x7f4a140ccad0 legacy=0x7f4a140cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7f4a13400640 1 -- 172.21.15.110:0/4101428142 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140cb060 con 0x7f4a140ca8a0 2024-08-17T02:29:15.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7fb825400640 1 Processor -- start 2024-08-17T02:29:15.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 -- 172.21.15.110:0/2092776058 shutdown_connections 2024-08-17T02:29:15.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 --2- 172.21.15.110:0/2092776058 >> v2:172.21.15.177:3300/0 conn(0x7ff4780cea00 0x7ff4780c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 --2- 172.21.15.110:0/2092776058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff47815c340 0x7ff4780cc010 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.454+0000 7ff47e400640 1 -- 172.21.15.110:0/2092776058 >> 172.21.15.110:0/2092776058 conn(0x7ff47806eb90 msgr2=0x7ff4780cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.455+0000 7fd618a00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7fd5f406d460 0x7fd5f406f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.455+0000 7fd613e00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd5f4065250 0x7fd5f4067700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6000017e0 tx=0x7fd600009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.455+0000 7fe295600640 1 -- 172.21.15.110:0/1740433729 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800317d0 con 0x7fe27c003720 2024-08-17T02:29:15.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7ff47e400640 1 -- 172.21.15.110:0/2092776058 shutdown_connections 2024-08-17T02:29:15.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fd618a00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7fd5f406d460 0x7fd5f406f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7f4a13400640 1 --2- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ca8a0 0x7f4a140cc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009850 tx=0x7f4a040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d09ddafc14b3a752 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.455+0000 7fb825400640 1 -- start start 2024-08-17T02:29:15.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7ff47e400640 1 -- 172.21.15.110:0/2092776058 wait complete. 2024-08-17T02:29:15.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7f4a12a00640 1 -- 172.21.15.110:0/4101428142 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0402ad90 con 0x7f4a140ca8a0 2024-08-17T02:29:15.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7f4a12a00640 1 -- 172.21.15.110:0/4101428142 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04032440 con 0x7f4a140ca8a0 2024-08-17T02:29:15.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7f4a12a00640 1 -- 172.21.15.110:0/4101428142 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a04032820 con 0x7f4a140ca8a0 2024-08-17T02:29:15.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fb825400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb82006a5e0 0x7fb82013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fb825400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 0x7fb8200adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fb825400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8200af6e0 con 0x7fb82013e2d0 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fb825400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200acb40 con 0x7fb82006a5e0 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fb825400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200ad6c0 con 0x7fb82006e7f0 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7fb817e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb82006a5e0 0x7fb82013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7fb81e800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb82013e2d0 0x7fb820069ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:39604/0 (socket says 172.21.15.110:39604) 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7fb81e800640 1 -- 172.21.15.110:0/2401383220 learned_addr learned my addr 172.21.15.110:0/2401383220 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7fb817e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb82006a5e0 0x7fb82013e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48850/0 (socket says 172.21.15.110:48850) 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fe297e00640 1 -- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 msgr2=0x7fe27c003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fe297e00640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 0x7fe27c003b90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe2800077a0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fe297e00640 1 -- 172.21.15.110:0/1740433729 shutdown_connections 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fe297e00640 1 --2- 172.21.15.110:0/1740433729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe27c003720 0x7fe27c003b90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.456+0000 7fe297e00640 1 -- 172.21.15.110:0/1740433729 >> 172.21.15.110:0/1740433729 conn(0x7fe298098e30 msgr2=0x7fe29806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7f4a19c00640 1 -- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ca8a0 msgr2=0x7f4a140cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.457+0000 7f4a19c00640 1 --2- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ca8a0 0x7f4a140cc590 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009850 tx=0x7f4a040090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== osd.0 v2:172.21.15.110:6800/37096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd5f406ff20 con 0x7fd5f406d460 2024-08-17T02:29:15.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 -- 172.21.15.110:0/4101428142 shutdown_connections 2024-08-17T02:29:15.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 --2- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ca8a0 0x7f4a140cc590 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 --2- 172.21.15.110:0/4101428142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a140ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 -- 172.21.15.110:0/4101428142 >> 172.21.15.110:0/4101428142 conn(0x7f4a14098e00 msgr2=0x7f4a1406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb817e00640 1 -- 172.21.15.110:0/2401383220 >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 msgr2=0x7fb8200adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb81f200640 1 --2- 172.21.15.110:0/2401383220 >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 0x7fb8200adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb817e00640 1 --2- 172.21.15.110:0/2401383220 >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 0x7fb8200adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb817e00640 1 -- 172.21.15.110:0/2401383220 >> v1:172.21.15.177:6789/0 conn(0x7fb82013e2d0 legacy=0x7fb820069ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7ff47e400640 1 Processor -- start 2024-08-17T02:29:15.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb817e00640 1 -- 172.21.15.110:0/2401383220 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200acd90 con 0x7fb82006a5e0 2024-08-17T02:29:15.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fe297e00640 1 -- 172.21.15.110:0/1740433729 shutdown_connections 2024-08-17T02:29:15.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7fb81f200640 1 --2- 172.21.15.110:0/2401383220 >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 0x7fb8200adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7ff47e400640 1 -- start start 2024-08-17T02:29:15.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 -- 172.21.15.110:0/4101428142 shutdown_connections 2024-08-17T02:29:15.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.458+0000 7f4a19c00640 1 -- 172.21.15.110:0/4101428142 wait complete. 2024-08-17T02:29:15.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.459+0000 7fe297e00640 1 -- 172.21.15.110:0/1740433729 wait complete. 2024-08-17T02:29:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.459+0000 7f59e7800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d80e6e70 0x7f59d803a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.459+0000 7f59e7800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d8053520 con 0x7f59d8038740 2024-08-17T02:29:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.459+0000 7fb817e00640 1 --2- 172.21.15.110:0/2401383220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb82013e6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8200afab0 tx=0x7fb8080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdefdc96a578ef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.459+0000 7f59e7800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d80e7950 con 0x7f59d8006150 2024-08-17T02:29:15.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7f59e5800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f59d8038740 0x7f59d8053a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41336/0 (socket says 172.21.15.110:41336) 2024-08-17T02:29:15.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 0x7ff47816e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7f59e5800640 1 -- 172.21.15.110:0/3580058669 learned_addr learned my addr 172.21.15.110:0/3580058669 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d803aeb0 con 0x7f59d80e6e70 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7fb81de00640 1 -- 172.21.15.110:0/2401383220 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80802abf0 con 0x7fb82006a5e0 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c340 0x7ff4780b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff47815c710 0x7ff4780b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780b4c00 con 0x7ff47815c710 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780b54a0 con 0x7ff47815c340 2024-08-17T02:29:15.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff47e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780c8770 con 0x7ff4780cea00 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 0x7ff47816e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 0x7ff47816e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51550/0 (socket says 172.21.15.110:51550) 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff477400640 1 -- 172.21.15.110:0/543445898 learned_addr learned my addr 172.21.15.110:0/543445898 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff46ea00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c340 0x7ff4780b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7ff477e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff47815c710 0x7ff4780b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7fb81de00640 1 -- 172.21.15.110:0/2401383220 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80802ad50 con 0x7fb82006a5e0 2024-08-17T02:29:15.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7fb81de00640 1 -- 172.21.15.110:0/2401383220 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808032670 con 0x7fb82006a5e0 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457490132 0 0) 0x7f59d80e7950 con 0x7f59d8006150 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c80034e0 con 0x7f59d8006150 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7f4a19c00640 1 Processor -- start 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.460+0000 7f4a19c00640 1 -- start start 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7ff477400640 1 -- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c340 msgr2=0x7ff4780b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7ff477400640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff47815c340 0x7ff4780b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7ff477400640 1 -- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff47815c710 msgr2=0x7ff4780b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7ff477400640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff47815c710 0x7ff4780b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7ff477400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009ae0 con 0x7ff4780cea00 2024-08-17T02:29:15.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908131593 0 0) 0x7f59d8053520 con 0x7f59d8038740 2024-08-17T02:29:15.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d80e7950 con 0x7f59d8038740 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830588120 0 0) 0x7f59c80034e0 con 0x7f59d8006150 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d80e6e70 msgr2=0x7f59d803a630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d80e6e70 0x7f59d803a630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 >> v1:172.21.15.110:6789/0 conn(0x7f59d8038740 legacy=0x7f59d8053a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d803b190 con 0x7f59d8006150 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f59cc001470 con 0x7f59d8006150 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 >> v1:172.21.15.177:6789/0 conn(0x7f59d8006150 legacy=0x7f59d80e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a140ca8a0 0x7f4a141550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ccad0 0x7f4a1409beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a141583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409d590 con 0x7f4a140ca8a0 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409c980 con 0x7f4a140ccad0 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1409cc60 con 0x7f4a14159ca0 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c8003b60 0x7f59c8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8004780 0x7f59c8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d803aeb0 con 0x7f59c8004780 2024-08-17T02:29:15.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c800c120 con 0x7f59c8005180 2024-08-17T02:29:15.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.461+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c800c2e0 con 0x7f59c8003b60 2024-08-17T02:29:15.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 -- 172.21.15.110:0/2401383220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 msgr2=0x7fb82013e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 --2- 172.21.15.110:0/2401383220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb82013e6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb8200afab0 tx=0x7fb8080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7ff477400640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 0x7ff47816e780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff468009f80 tx=0x7ff468036000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 -- 172.21.15.110:0/2401383220 shutdown_connections 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 --2- 172.21.15.110:0/2401383220 >> v2:172.21.15.177:3300/0 conn(0x7fb82006e7f0 0x7fb8200adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 --2- 172.21.15.110:0/2401383220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb82013e6a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 -- 172.21.15.110:0/2401383220 >> 172.21.15.110:0/2401383220 conn(0x7fb8200cc480 msgr2=0x7fb8200687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468031860 con 0x7ff4780cea00 2024-08-17T02:29:15.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468008ad0 con 0x7ff4780cea00 2024-08-17T02:29:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 -- 172.21.15.110:0/2401383220 shutdown_connections 2024-08-17T02:29:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7fb825400640 1 -- 172.21.15.110:0/2401383220 wait complete. 2024-08-17T02:29:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f59dfe00640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8004780 0x7f59c8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a141583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a13400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ccad0 0x7f4a1409beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a141583c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51564/0 (socket says 172.21.15.110:51564) 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.462+0000 7f4a19200640 1 -- 172.21.15.110:0/1397676674 learned_addr learned my addr 172.21.15.110:0/1397676674 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a13e00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a140ca8a0 0x7f4a141550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7ff47e400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4780c8a30 con 0x7ff4780cea00 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7ff47e400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4780c8ff0 con 0x7ff4780cea00 2024-08-17T02:29:15.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7fe297e00640 1 Processor -- start 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a19200640 1 -- 172.21.15.110:0/1397676674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ccad0 msgr2=0x7f4a1409beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a19200640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a140ccad0 0x7f4a1409beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a19200640 1 -- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a140ca8a0 msgr2=0x7f4a141550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a19200640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a140ca8a0 0x7f4a141550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f4a19200640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04009390 con 0x7f4a14159ca0 2024-08-17T02:29:15.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7fe297e00640 1 -- start start 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f4a19200640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a141583c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c890 tx=0x7f4a0c001630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468008e90 con 0x7ff4780cea00 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7ff47e400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4780897a0 con 0x7ff4780cea00 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7fe297e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 0x7fe2980b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7fe297e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe298168810 0x7fe2980b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe297e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2980b1620 0x7fe2980b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe296a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 0x7fe2980b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe296a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 0x7fe2980b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48870/0 (socket says 172.21.15.110:48870) 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe296a00640 1 -- 172.21.15.110:0/485478010 learned_addr learned my addr 172.21.15.110:0/485478010 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f59e5800640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.463+0000 7f59e4e00640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c8003b60 0x7f59c8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f59e5800640 1 -- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c8003b60 msgr2=0x7f59c8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f59e5800640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59c8003b60 0x7f59c8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f59e5800640 1 -- 172.21.15.110:0/3580058669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8004780 msgr2=0x7f59c8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f59e5800640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c8004780 0x7f59c8004bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f59e5800640 1 -- 172.21.15.110:0/3580058669 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d803b190 con 0x7f59c8005180 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f59e5800640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59c800b9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59d4001ac0 tx=0x7f59d4007d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519965b21562d5c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7fb825400640 1 Processor -- start 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7fb825400640 1 -- start start 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f6bece00640 1 Processor -- start 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f6bece00640 1 -- start start 2024-08-17T02:29:15.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f6bece00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6be8153100 0x7f6be8159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f6bece00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6be80accc0 0x7f6be80a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7fc1b6600640 1 Processor -- start 2024-08-17T02:29:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f6bece00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be8159740 con 0x7f6be80a9e20 2024-08-17T02:29:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f6bece00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be80cd3b0 con 0x7f6be80accc0 2024-08-17T02:29:15.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7f6bece00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be815c9c0 con 0x7f6be8153100 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00ce80 con 0x7f4a14159ca0 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00a850 con 0x7f4a14159ca0 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00abf0 con 0x7f4a14159ca0 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7f4a19c00640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1409cf40 con 0x7f4a14159ca0 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.465+0000 7f4a19c00640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1409b200 con 0x7f4a14159ca0 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff468038050 con 0x7ff4780cea00 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7ff46f400640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff454065150 0x7ff454067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4680a2e50 con 0x7ff4780cea00 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7ff46f400640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7ff45406d170 0x7ff45406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff45406fc30 con 0x7ff45406d170 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b1fb0 con 0x7fe27c003720 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe298152cc0 con 0x7fe2980b1620 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b42c0 con 0x7fe298168810 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe297400640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2980b1620 0x7fe2980b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fe296000640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe298168810 0x7fe2980b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe296a00640 1 -- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe298168810 msgr2=0x7fe2980b10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe296a00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe298168810 0x7fe2980b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe296a00640 1 -- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2980b1620 msgr2=0x7fe2980b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe296a00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2980b1620 0x7fe2980b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe296a00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980af430 con 0x7fe27c003720 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fe297400640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2980b1620 0x7fe2980b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d402aba0 con 0x7f59c8005180 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d402ad20 con 0x7f59c8005180 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f59df400640 1 -- 172.21.15.110:0/3580058669 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4004ab0 con 0x7f59c8005180 2024-08-17T02:29:15.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7f6be7400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6be8153100 0x7f6be8159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7f6be7400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6be8153100 0x7f6be8159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56224/0 (socket says 172.21.15.110:56224) 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7f6be7400640 1 -- 172.21.15.110:0/1485022069 learned_addr learned my addr 172.21.15.110:0/1485022069 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7f6be6a00640 1 --2- 172.21.15.110:0/1485022069 >> v2:172.21.15.110:3300/0 conn(0x7f6be80accc0 0x7f6be80a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f6be7400640 1 -- 172.21.15.110:0/1485022069 >> v2:172.21.15.110:3300/0 conn(0x7f6be80accc0 msgr2=0x7f6be80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f6be7400640 1 --2- 172.21.15.110:0/1485022069 >> v2:172.21.15.110:3300/0 conn(0x7f6be80accc0 0x7f6be80a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f6be7400640 1 -- 172.21.15.110:0/1485022069 >> v1:172.21.15.110:6789/0 conn(0x7f6be80a9e20 legacy=0x7f6be815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f6be7400640 1 -- 172.21.15.110:0/1485022069 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8159970 con 0x7f6be8153100 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.464+0000 7fc1b6600640 1 -- start start 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fc1b6600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b00ada10 0x7fc1b00b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fc1b6600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00d0ab0 con 0x7fc1b00b38b0 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fc1b6600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b00b00c0 con 0x7fc1b00b1120 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.466+0000 7fc1b6600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0360 con 0x7fc1b00ada10 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fc1aea00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc1b00b1120 0x7fc1b00b31a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:39618/0 (socket says 172.21.15.110:39618) 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fc1aea00640 1 -- 172.21.15.110:0/368566590 learned_addr learned my addr 172.21.15.110:0/368566590 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110400992 0 0) 0x7fc1b00b00c0 con 0x7fc1b00b1120 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1940034e0 con 0x7fc1b00b1120 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fb825400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb820139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.467+0000 7fb825400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb82006e7f0 0x7fb82016d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb825400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb82013e2d0 0x7fb820157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb825400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82013a000 con 0x7fb82006a5e0 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7ff46ea00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff454065150 0x7ff454067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb825400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201572f0 con 0x7fb82006e7f0 2024-08-17T02:29:15.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb825400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82016de40 con 0x7fb82013e2d0 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862403208 0 0) 0x7fc1940034e0 con 0x7fc1b00b1120 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b00ada10 msgr2=0x7fc1b00b2c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b00ada10 0x7fc1b00b2c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 >> v1:172.21.15.110:6789/0 conn(0x7fc1b00b38b0 legacy=0x7fc1b00aedf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00b0640 con 0x7fc1b00b1120 2024-08-17T02:29:15.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fc1a00017f0 con 0x7fc1b00b1120 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 >> v1:172.21.15.177:6789/0 conn(0x7fc1b00b1120 legacy=0x7fc1b00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc194003a50 0x7fc194003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc194004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc194005330 0x7fc19400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0360 con 0x7fc194005330 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19400c170 con 0x7fc194004780 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19400c330 con 0x7fc194003a50 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb81e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb820139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7fb81f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb82013e2d0 0x7fb820157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fb81f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb82013e2d0 0x7fb820157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51592/0 (socket says 172.21.15.110:51592) 2024-08-17T02:29:15.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fb81f200640 1 -- 172.21.15.110:0/800171971 learned_addr learned my addr 172.21.15.110:0/800171971 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fc1aea00640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc194004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fe296a00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 0x7fe2980b3360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe288002220 tx=0x7fe288001ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800ee80 con 0x7fe27c003720 2024-08-17T02:29:15.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fc1af400640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc194003a50 0x7fc194003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7ff477e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7ff45406d170 0x7ff45406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288013420 con 0x7fe27c003720 2024-08-17T02:29:15.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28800ee80 con 0x7fe27c003720 2024-08-17T02:29:15.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2980b3a20 con 0x7fe27c003720 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980b3fe0 con 0x7fe27c003720 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.468+0000 7f4a19c00640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a14071050 con 0x7f4a14159ca0 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a0c003030 con 0x7f4a14159ca0 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 msgr2=0x7f59c800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 --2- 172.21.15.110:0/3580058669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59c800b9d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f59d4001ac0 tx=0x7f59d4007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:15.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e5800640 1 -- 172.21.15.110:0/3580058669 reap_dead start 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.469+0000 7fb817e00640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb82006e7f0 0x7fb82016d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fb817e00640 1 -- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb82013e2d0 msgr2=0x7fb820157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fb817e00640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb82013e2d0 0x7fb820157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7fb817e00640 1 -- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 msgr2=0x7fb820139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 shutdown_connections 2024-08-17T02:29:15.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 >> 172.21.15.110:0/3580058669 conn(0x7f59d800f070 msgr2=0x7f59d8058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7ff46ea00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff454065150 0x7ff454067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4780c8490 tx=0x7ff460009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff468070e70 con 0x7ff4780cea00 2024-08-17T02:29:15.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 shutdown_connections 2024-08-17T02:29:15.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f6be7400640 1 --2- 172.21.15.110:0/1485022069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 0x7f6be8159200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be806c730 tx=0x7f6bd40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b64b052f155cebe server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f4a0b400640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f49f4065220 0x7f49f40676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a0c082410 con 0x7f4a14159ca0 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f4a13e00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f49f4065220 0x7f49f40676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f4a0b400640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f49f406d430 0x7f49f406f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49f406fef0 con 0x7f49f406d430 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a0c084970 con 0x7f4a14159ca0 2024-08-17T02:29:15.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7ff477e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7ff45406d170 0x7ff45406f580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe298071050 con 0x7fe27c003720 2024-08-17T02:29:15.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f6be6000640 1 -- 172.21.15.110:0/1485022069 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd402add0 con 0x7f6be8153100 2024-08-17T02:29:15.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f6be6000640 1 -- 172.21.15.110:0/1485022069 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4032440 con 0x7f6be8153100 2024-08-17T02:29:15.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7f6be6000640 1 -- 172.21.15.110:0/1485022069 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4032820 con 0x7f6be8153100 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.472+0000 7f4a13e00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f49f4065220 0x7f49f40676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006f30 tx=0x7f4a00008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.470+0000 7f59e7800640 1 -- 172.21.15.110:0/3580058669 wait complete. 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fc1aea00640 1 -- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc194003a50 msgr2=0x7fc194003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fc1aea00640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc194003a50 0x7fc194003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fc1aea00640 1 -- 172.21.15.110:0/368566590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc194005330 msgr2=0x7fc19400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fc1aea00640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc194005330 0x7fc19400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.471+0000 7fc1aea00640 1 -- 172.21.15.110:0/368566590 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00b0640 con 0x7fc194004780 2024-08-17T02:29:15.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.472+0000 7fb817e00640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb820139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.472+0000 7fb817e00640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb808009390 con 0x7fb82006e7f0 2024-08-17T02:29:15.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.472+0000 7fb81e800640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb82006a5e0 0x7fb820139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 -- 172.21.15.110:0/1485022069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 msgr2=0x7f6be8159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 --2- 172.21.15.110:0/1485022069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 0x7f6be8159200 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6be806c730 tx=0x7f6bd40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== osd.1 v2:172.21.15.110:6824/37110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff45406fc30 con 0x7ff45406d170 2024-08-17T02:29:15.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f59e7800640 1 Processor -- start 2024-08-17T02:29:15.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fc1aea00640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc194004bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a9b0 tx=0x7fc1a00021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66115c99e36901cf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fb817e00640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb82006e7f0 0x7fb82016d900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb808031000 tx=0x7fb808032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 -- 172.21.15.110:0/1485022069 shutdown_connections 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 --2- 172.21.15.110:0/1485022069 >> v2:172.21.15.110:3300/0 conn(0x7f6be80accc0 0x7f6be80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 --2- 172.21.15.110:0/1485022069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 0x7f6be8159200 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 -- 172.21.15.110:0/1485022069 >> 172.21.15.110:0/1485022069 conn(0x7f6be8068860 msgr2=0x7f6be80cc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002b530 con 0x7fc194004780 2024-08-17T02:29:15.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f4a13400640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f49f406d430 0x7f49f406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a002b6d0 con 0x7fc194004780 2024-08-17T02:29:15.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fc1ae000640 1 -- 172.21.15.110:0/368566590 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a002bad0 con 0x7fc194004780 2024-08-17T02:29:15.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f59e7800640 1 -- start start 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 -- 172.21.15.110:0/1485022069 shutdown_connections 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.474+0000 7f4a13400640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f49f406d430 0x7f49f406f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80803e730 con 0x7fb82006e7f0 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80803e8b0 con 0x7fb82006e7f0 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80803ecb0 con 0x7fb82006e7f0 2024-08-17T02:29:15.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8201566e0 con 0x7fb82006e7f0 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.474+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb820156ca0 con 0x7fb82006e7f0 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.474+0000 7f59e7800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59d80e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e7800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d8052620 0x7f59d8050950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59d804db20 0x7f59d804dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d804d690 con 0x7f59d804db20 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e7800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d804ca80 con 0x7f59c8005180 2024-08-17T02:29:15.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e7800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d804cd60 con 0x7f59d8052620 2024-08-17T02:29:15.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1b6600640 1 -- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 msgr2=0x7fc194004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1b6600640 1 --2- 172.21.15.110:0/368566590 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc194004bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a9b0 tx=0x7fc1a00021e0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1afe00640 1 -- 172.21.15.110:0/368566590 reap_dead start 2024-08-17T02:29:15.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59d80e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59d80e0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56242/0 (socket says 172.21.15.110:56242) 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e4e00640 1 -- 172.21.15.110:0/3865579766 learned_addr learned my addr 172.21.15.110:0/3865579766 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59dfe00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d8052620 0x7f59d8050950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f59e5800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59d804db20 0x7f59d804dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb820064db0 con 0x7fb82006e7f0 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1b6600640 1 -- 172.21.15.110:0/368566590 shutdown_connections 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1b6600640 1 -- 172.21.15.110:0/368566590 >> 172.21.15.110:0/368566590 conn(0x7fc1b00cfdf0 msgr2=0x7fc1b00d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7fc1b6600640 1 -- 172.21.15.110:0/368566590 shutdown_connections 2024-08-17T02:29:15.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 -- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d8052620 msgr2=0x7f59d8050950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d8052620 0x7f59d8050950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.473+0000 7f6bece00640 1 -- 172.21.15.110:0/1485022069 wait complete. 2024-08-17T02:29:15.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 -- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59d804db20 msgr2=0x7f59d804dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59d804db20 0x7f59d804dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d804d040 con 0x7f59c8005180 2024-08-17T02:29:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.475+0000 7f6bece00640 1 Processor -- start 2024-08-17T02:29:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7fc1b6600640 1 -- 172.21.15.110:0/368566590 wait complete. 2024-08-17T02:29:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== osd.3 v2:172.21.15.110:6815/37098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f49f406fef0 con 0x7f49f406d430 2024-08-17T02:29:15.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59e4e00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59d80e0610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59e005ea30 tx=0x7f59e0069040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7f59dfe00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59d8052620 0x7f59d8050950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2880137e0 con 0x7fe27c003720 2024-08-17T02:29:15.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.477+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0064530 con 0x7f59c8005180 2024-08-17T02:29:15.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.477+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0064690 con 0x7f59c8005180 2024-08-17T02:29:15.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.477+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e00906c0 con 0x7f59c8005180 2024-08-17T02:29:15.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.477+0000 7f6bece00640 1 -- start start 2024-08-17T02:29:15.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.477+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d804d320 con 0x7f59c8005180 2024-08-17T02:29:15.518 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fe28e000640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2740651e0 0x7fe274067690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.476+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb808031630 con 0x7fb82006e7f0 2024-08-17T02:29:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fb816000640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb7fc065220 0x7fb7fc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb8080a2840 con 0x7fb82006e7f0 2024-08-17T02:29:15.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8051030 con 0x7f59c8005180 2024-08-17T02:29:15.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fb816000640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fb7fc06d430 0x7fb7fc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fc1b6600640 1 Processor -- start 2024-08-17T02:29:15.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7fc06fef0 con 0x7fb7fc06d430 2024-08-17T02:29:15.520 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8080a4da0 con 0x7fb82006e7f0 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fc1b6600640 1 -- start start 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7fb81e800640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb7fc065220 0x7fb7fc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 0x7f6be80b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be80accc0 0x7f6be806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f59e008d070 con 0x7f59c8005180 2024-08-17T02:29:15.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 0x7f6be8147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be8149390 con 0x7f6be80accc0 2024-08-17T02:29:15.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be80b08a0 con 0x7f6be8153100 2024-08-17T02:29:15.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.479+0000 7f6bece00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be81484a0 con 0x7f6be80a9e20 2024-08-17T02:29:15.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2880833d0 con 0x7fe27c003720 2024-08-17T02:29:15.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 0x7f6be80b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 0x7f6be80b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51624/0 (socket says 172.21.15.110:51624) 2024-08-17T02:29:15.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 -- 172.21.15.110:0/3439885105 learned_addr learned my addr 172.21.15.110:0/3439885105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fe28e000640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7fe27406d3f0 0x7fe27406f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe27406feb0 con 0x7fe27406d3f0 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.478+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2880836c0 con 0x7fe27c003720 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7fb81e800640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb7fc065220 0x7fb7fc0676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8100017d0 tx=0x7fb810007e40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59d8005320 con 0x7f59c8005180 2024-08-17T02:29:15.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 -- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 msgr2=0x7f6be8147010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f59d3e00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f59c0065250 0x7f59c0067700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6be8153100 0x7f6be8147010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 -- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be80accc0 msgr2=0x7f6be806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7fe296000640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2740651e0 0x7fe274067690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7fe297400640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7fe27406d3f0 0x7fe27406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6be80accc0 0x7f6be806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.480+0000 7f6be7400640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4009450 con 0x7f6be80a9e20 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59e00ca480 con 0x7f59c8005180 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59d3e00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f59c006d3e0 0x7f59c006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59dfe00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f59c0065250 0x7f59c0067700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59c006fea0 con 0x7f59c006d3e0 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59e00c60c0 con 0x7f59c8005180 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f6be7400640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 0x7f6be80b0360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009940 tx=0x7f6bd4032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7fe297400640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7fe27406d3f0 0x7fe27406f800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7fe296000640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2740651e0 0x7fe274067690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe280035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f59e5800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f59c006d3e0 0x7f59c006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4031de0 con 0x7f6be80a9e20 2024-08-17T02:29:15.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.481+0000 7fc1b6600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc1b00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4000c40 con 0x7f6be80a9e20 2024-08-17T02:29:15.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be8148780 con 0x7f6be80a9e20 2024-08-17T02:29:15.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd403e6a0 con 0x7f6be80a9e20 2024-08-17T02:29:15.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7fc1b6600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 0x7fc1b0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7fc1b6600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1b014b9a0 0x7fc1b0150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be8148d40 con 0x7f6be80a9e20 2024-08-17T02:29:15.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6be8071050 con 0x7f6be80a9e20 2024-08-17T02:29:15.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7f59e5800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f59c006d3e0 0x7f59c006f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.482+0000 7fc1aea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 0x7fc1b0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1aea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 0x7fc1b0159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51630/0 (socket says 172.21.15.110:51630) 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1b014b9a0 0x7fc1b0150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1b014b9a0 0x7fc1b0150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48922/0 (socket says 172.21.15.110:48922) 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1aea00640 1 -- 172.21.15.110:0/401207529 learned_addr learned my addr 172.21.15.110:0/401207529 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b015b260 con 0x7fc1b014b9a0 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b015a650 con 0x7fc194004780 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b015a930 con 0x7fc1b015b6f0 2024-08-17T02:29:15.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7f59dfe00640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f59c0065250 0x7f59c0067700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f59d80f9ab0 tx=0x7f59cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.483+0000 7fb81f200640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fb7fc06d430 0x7fb7fc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== osd.4 v2:172.21.15.177:6800/37516 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f59c006fea0 con 0x7f59c006d3e0 2024-08-17T02:29:15.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fb81f200640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fb7fc06d430 0x7fb7fc06f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== osd.2 v2:172.21.15.110:6808/37099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe27406feb0 con 0x7fe27406d3f0 2024-08-17T02:29:15.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6bd403c400 con 0x7f6be80a9e20 2024-08-17T02:29:15.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1af400640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc1b00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1aea00640 1 -- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 msgr2=0x7fc1b00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1aea00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc194004780 0x7fc1b00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1aea00640 1 -- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1b014b9a0 msgr2=0x7fc1b0150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== osd.5 v2:172.21.15.177:6804/37515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fb7fc06fef0 con 0x7fb7fc06d430 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1aea00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1b014b9a0 0x7fc1b0150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.484+0000 7fc1aea00640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b015ac10 con 0x7fc1b015b6f0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fc1aea00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 0x7fc1b0159df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002b0f0 tx=0x7fc1a0031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a003b040 con 0x7fc1b015b6f0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a00072e0 con 0x7fc1b015b6f0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a00076a0 con 0x7fc1b015b6f0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.485+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b015aef0 con 0x7fc1b015b6f0 2024-08-17T02:29:15.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.486+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b014bd70 con 0x7fc1b015b6f0 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.486+0000 7f6bdea00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6bc80651d0 0x7f6bc8067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.487+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bd40a34b0 con 0x7f6be80a9e20 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.487+0000 7f6bdea00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7f6bc806d3e0 0x7f6bc806f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.487+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bc806fea0 con 0x7f6bc806d3e0 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.487+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd40a37e0 con 0x7f6be80a9e20 2024-08-17T02:29:15.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.487+0000 7f6be6a00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6bc80651d0 0x7f6bc8067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.488+0000 7f6be7e00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7f6bc806d3e0 0x7f6bc806f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.489+0000 7f6be7e00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7f6bc806d3e0 0x7f6bc806f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.489+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1b0064db0 con 0x7fc1b015b6f0 2024-08-17T02:29:15.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.490+0000 7f6be6a00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6bc80651d0 0x7f6bc8067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006fd0 tx=0x7f6bd8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.490+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== osd.6 v2:172.21.15.177:6822/37518 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6bc806fea0 con 0x7f6bc806d3e0 2024-08-17T02:29:15.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.490+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc1a0031070 con 0x7fc1b015b6f0 2024-08-17T02:29:15.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.492+0000 7fc1a6a00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc18c065220 0x7fc18c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.494+0000 7fc1af400640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc18c065220 0x7fc18c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.495+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1a0074e50 con 0x7fc1b015b6f0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.495+0000 7fc1a6a00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fc18c06d3b0 0x7fc18c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.496+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc18c06fe70 con 0x7fc18c06d3b0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.496+0000 7fc1afe00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fc18c06d3b0 0x7fc18c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.497+0000 7fc1af400640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc18c065220 0x7fc18c0676d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8006fd0 tx=0x7fc1a8006e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.497+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1a0071190 con 0x7fc1b015b6f0 2024-08-17T02:29:15.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.498+0000 7ff47e400640 1 -- 172.21.15.110:0/543445898 --> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff478071050 con 0x7ff45406d170 2024-08-17T02:29:15.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.499+0000 7ff46f400640 1 -- 172.21.15.110:0/543445898 <== osd.1 v2:172.21.15.110:6824/37110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff478071050 con 0x7ff45406d170 2024-08-17T02:29:15.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.500+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 --> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd60c005770 con 0x7fd5f406d460 2024-08-17T02:29:15.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.500+0000 7fc1afe00640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fc18c06d3b0 0x7fc18c06f7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.501+0000 7fd607400640 1 -- 172.21.15.110:0/272041330 <== osd.0 v2:172.21.15.110:6800/37096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd60c005770 con 0x7fd5f406d460 2024-08-17T02:29:15.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.501+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== osd.7 v2:172.21.15.177:6816/37517 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc18c06fe70 con 0x7fc18c06d3b0 2024-08-17T02:29:15.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.502+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7ff45406d170 msgr2=0x7ff45406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.502+0000 7ff467e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7ff45406d170 0x7ff45406f580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.503+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7fd5f406d460 msgr2=0x7fd5f406f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.503+0000 7fd61aa00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7fd5f406d460 0x7fd5f406f870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.503+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff454065150 msgr2=0x7ff454067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.503+0000 7ff467e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff454065150 0x7ff454067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4780c8490 tx=0x7ff460009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.504+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 msgr2=0x7ff47816e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.504+0000 7ff467e00640 1 --2- 172.21.15.110:0/543445898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4780cea00 0x7ff47816e780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff468009f80 tx=0x7ff468036000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.504+0000 7ff477e00640 1 -- 172.21.15.110:0/543445898 reap_dead start 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.504+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 shutdown_connections 2024-08-17T02:29:15.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.504+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 >> 172.21.15.110:0/543445898 conn(0x7ff47806eb90 msgr2=0x7ff4780d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd5f4065250 msgr2=0x7fd5f4067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd5f4065250 0x7fd5f4067700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6000017e0 tx=0x7fd600009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd60c054ff0 msgr2=0x7fd60c04d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 --2- 172.21.15.110:0/272041330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd60c054ff0 0x7fd60c04d2c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd614000b60 tx=0x7fd614064990 comp rx=0 tx=0).stop 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd618a00640 1 -- 172.21.15.110:0/272041330 reap_dead start 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 shutdown_connections 2024-08-17T02:29:15.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 shutdown_connections 2024-08-17T02:29:15.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 >> 172.21.15.110:0/272041330 conn(0x7fd60c00f050 msgr2=0x7fd60c057ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7ff467e00640 1 -- 172.21.15.110:0/543445898 wait complete. 2024-08-17T02:29:15.545 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 --> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59d80599f0 con 0x7f59c006d3e0 2024-08-17T02:29:15.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 shutdown_connections 2024-08-17T02:29:15.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.505+0000 7fd61aa00640 1 -- 172.21.15.110:0/272041330 wait complete. 2024-08-17T02:29:15.546 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59d3e00640 1 -- 172.21.15.110:0/3865579766 <== osd.4 v2:172.21.15.177:6800/37516 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59d80599f0 con 0x7f59c006d3e0 2024-08-17T02:29:15.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f59c006d3e0 msgr2=0x7f59c006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59e7800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f59c006d3e0 0x7f59c006f7f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f59c0065250 msgr2=0x7f59c0067700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59e7800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f59c0065250 0x7f59c0067700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f59d80f9ab0 tx=0x7f59cc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.506+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 msgr2=0x7f59d80e0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.507+0000 7f59e7800640 1 --2- 172.21.15.110:0/3865579766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59c8005180 0x7f59d80e0610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59e005ea30 tx=0x7f59e0069040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.507+0000 7f59e5800640 1 -- 172.21.15.110:0/3865579766 reap_dead start 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.507+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 shutdown_connections 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.507+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 >> 172.21.15.110:0/3865579766 conn(0x7f59d800f070 msgr2=0x7f59d8056ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.509+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 shutdown_connections 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.509+0000 7f59e7800640 1 -- 172.21.15.110:0/3865579766 wait complete. 2024-08-17T02:29:15.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.512+0000 7f4a19c00640 1 -- 172.21.15.110:0/1397676674 --> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a14070430 con 0x7f49f406d430 2024-08-17T02:29:15.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.514+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 --> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2980ae9c0 con 0x7fe27406d3f0 2024-08-17T02:29:15.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.516+0000 7fe28e000640 1 -- 172.21.15.110:0/485478010 <== osd.2 v2:172.21.15.110:6808/37099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2980ae9c0 con 0x7fe27406d3f0 2024-08-17T02:29:15.549 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.517+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 --> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb82006ad20 con 0x7fb7fc06d430 2024-08-17T02:29:15.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.516+0000 7f4a0b400640 1 -- 172.21.15.110:0/1397676674 <== osd.3 v2:172.21.15.110:6815/37098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a14070430 con 0x7f49f406d430 2024-08-17T02:29:15.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.517+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7fe27406d3f0 msgr2=0x7fe27406f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.517+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f49f406d430 msgr2=0x7f49f406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.550 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.517+0000 7f4a08c00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f49f406d430 0x7f49f406f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.517+0000 7fe297e00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7fe27406d3f0 0x7fe27406f800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2740651e0 msgr2=0x7fe274067690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2740651e0 0x7fe274067690 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe280034000 tx=0x7fe280035000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 msgr2=0x7fe2980b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.551 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 --2- 172.21.15.110:0/485478010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe27c003720 0x7fe2980b3360 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe288002220 tx=0x7fe288001ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297400640 1 -- 172.21.15.110:0/485478010 reap_dead start 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 shutdown_connections 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 >> 172.21.15.110:0/485478010 conn(0x7fe298098e30 msgr2=0x7fe298067420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f49f4065220 msgr2=0x7f49f40676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7f4a08c00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f49f4065220 0x7f49f40676d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4a00006f30 tx=0x7f4a00008040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 msgr2=0x7f4a141583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.552 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.519+0000 7f4a08c00640 1 --2- 172.21.15.110:0/1397676674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a14159ca0 0x7f4a141583c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00c890 tx=0x7f4a0c001630 comp rx=0 tx=0).stop 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 shutdown_connections 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7fe297e00640 1 -- 172.21.15.110:0/485478010 wait complete. 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7f4a19200640 1 -- 172.21.15.110:0/1397676674 reap_dead start 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 shutdown_connections 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 >> 172.21.15.110:0/1397676674 conn(0x7f4a14098e00 msgr2=0x7f4a141570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.553 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7fb816000640 1 -- 172.21.15.110:0/800171971 <== osd.5 v2:172.21.15.177:6804/37515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb82006ad20 con 0x7fb7fc06d430 2024-08-17T02:29:15.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.520+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 shutdown_connections 2024-08-17T02:29:15.554 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.521+0000 7f4a08c00640 1 -- 172.21.15.110:0/1397676674 wait complete. 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.521+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fb7fc06d430 msgr2=0x7fb7fc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.521+0000 7fb825400640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fb7fc06d430 0x7fb7fc06f840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.521+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb7fc065220 msgr2=0x7fb7fc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.521+0000 7fb825400640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb7fc065220 0x7fb7fc0676d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb8100017d0 tx=0x7fb810007e40 comp rx=0 tx=0).stop 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.522+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb82006e7f0 msgr2=0x7fb82016d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.522+0000 7fb825400640 1 --2- 172.21.15.110:0/800171971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb82006e7f0 0x7fb82016d900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb808031000 tx=0x7fb808032000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.522+0000 7fb81f200640 1 -- 172.21.15.110:0/800171971 reap_dead start 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.522+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 shutdown_connections 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.522+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 >> 172.21.15.110:0/800171971 conn(0x7fb8200cc480 msgr2=0x7fb82013d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.523+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 shutdown_connections 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.523+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 --> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6be8067b20 con 0x7f6bc806d3e0 2024-08-17T02:29:15.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.523+0000 7fb825400640 1 -- 172.21.15.110:0/800171971 wait complete. 2024-08-17T02:29:15.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.524+0000 7f6bdea00640 1 -- 172.21.15.110:0/3439885105 <== osd.6 v2:172.21.15.177:6822/37518 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6be8067b20 con 0x7f6bc806d3e0 2024-08-17T02:29:15.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.526+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7f6bc806d3e0 msgr2=0x7f6bc806f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.526+0000 7f6bece00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7f6bc806d3e0 0x7f6bc806f7f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.558 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:15.558 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:29:15.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6bc80651d0 msgr2=0x7f6bc8067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6bc80651d0 0x7f6bc8067680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8006fd0 tx=0x7f6bd8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 msgr2=0x7f6be80b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 --2- 172.21.15.110:0/3439885105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6be80a9e20 0x7f6be80b0360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6bd4009940 tx=0x7f6bd4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6be7e00640 1 -- 172.21.15.110:0/3439885105 reap_dead start 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 shutdown_connections 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.528+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 >> 172.21.15.110:0/3439885105 conn(0x7f6be8068860 msgr2=0x7f6be815bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.529+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 shutdown_connections 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.529+0000 7f6bece00640 1 -- 172.21.15.110:0/3439885105 wait complete. 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.531+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 --> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc1b014bff0 con 0x7fc18c06d3b0 2024-08-17T02:29:15.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.532+0000 7fc1a6a00640 1 -- 172.21.15.110:0/401207529 <== osd.7 v2:172.21.15.177:6816/37517 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc1b014bff0 con 0x7fc18c06d3b0 2024-08-17T02:29:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.532+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fc18c06d3b0 msgr2=0x7fc18c06f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.532+0000 7fc1b6600640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fc18c06d3b0 0x7fc18c06f7c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc18c065220 msgr2=0x7fc18c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc18c065220 0x7fc18c0676d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8006fd0 tx=0x7fc1a8006e10 comp rx=0 tx=0).stop 2024-08-17T02:29:15.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 msgr2=0x7fc1b0159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 --2- 172.21.15.110:0/401207529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1b015b6f0 0x7fc1b0159df0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc1a002b0f0 tx=0x7fc1a0031000 comp rx=0 tx=0).stop 2024-08-17T02:29:15.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1afe00640 1 -- 172.21.15.110:0/401207529 reap_dead start 2024-08-17T02:29:15.562 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:15.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:29:15.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 shutdown_connections 2024-08-17T02:29:15.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.533+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 >> 172.21.15.110:0/401207529 conn(0x7fc1b00cfdf0 msgr2=0x7fc1b00b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.563 INFO:teuthology.orchestra.run.smithi110.stdout:60129542150 2024-08-17T02:29:15.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.534+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 shutdown_connections 2024-08-17T02:29:15.564 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:29:15.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.534+0000 7fc1b6600640 1 -- 172.21.15.110:0/401207529 wait complete. 2024-08-17T02:29:15.565 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:15.566 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:29:15.566 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:15.567 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:29:15.567 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:15.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:29:15.568 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:15.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:29:15.569 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:15.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:29:15.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.864+0000 7f2d19c00640 1 Processor -- start 2024-08-17T02:29:15.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.865+0000 7f2d19c00640 1 -- start start 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d14159ca0 0x7f2d140ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 0x7f2d140cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ccad0 0x7f2d140cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d140cd6e0 con 0x7f2d14159ca0 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d140ccf70 con 0x7f2d140ca8a0 2024-08-17T02:29:15.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.867+0000 7f2d19c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d140cadc0 con 0x7f2d140ccad0 2024-08-17T02:29:15.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.868+0000 7f2d13400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 0x7f2d140cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.868+0000 7f2d13400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 0x7f2d140cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56274/0 (socket says 172.21.15.110:56274) 2024-08-17T02:29:15.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.868+0000 7f2d13400640 1 -- 172.21.15.110:0/2930441542 learned_addr learned my addr 172.21.15.110:0/2930441542 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.868+0000 7f2d13e00640 1 --2- 172.21.15.110:0/2930441542 >> v2:172.21.15.110:3300/0 conn(0x7f2d14159ca0 0x7f2d140ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.868+0000 7f2d19200640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ccad0 0x7f2d140cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f19b0a00640 1 Processor -- start 2024-08-17T02:29:15.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f2d13e00640 1 -- 172.21.15.110:0/2930441542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ccad0 msgr2=0x7f2d140cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f19b0a00640 1 -- start start 2024-08-17T02:29:15.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f2d13e00640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ccad0 0x7f2d140cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f2d13e00640 1 -- 172.21.15.110:0/2930441542 >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 msgr2=0x7f2d140cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f2d13e00640 1 --2- 172.21.15.110:0/2930441542 >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 0x7f2d140cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.869+0000 7f2d13e00640 1 -- 172.21.15.110:0/2930441542 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d140cb060 con 0x7f2d14159ca0 2024-08-17T02:29:15.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.870+0000 7f2d13e00640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d14159ca0 0x7f2d140ca360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d1408a060 tx=0x7f2d000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770cf6780be441d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7faded400640 1 Processor -- start 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19b0a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19ac0c6250 0x7f19ac0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19b0a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac0b44a0 con 0x7f19ac0b4020 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19b0a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac0b4700 con 0x7f19ac15d610 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19b0a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac0c4c20 con 0x7f19ac0c6250 2024-08-17T02:29:15.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7faded400640 1 -- start start 2024-08-17T02:29:15.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19a9e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19ac0c6250 0x7f19ac0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19a1400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f19ac0b4020 0x7f19ac15cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41342/0 (socket says 172.21.15.110:41342) 2024-08-17T02:29:15.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.871+0000 7f19a1400640 1 -- 172.21.15.110:0/3301376633 learned_addr learned my addr 172.21.15.110:0/3301376633 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.873+0000 7f2d12a00640 1 -- 172.21.15.110:0/2930441542 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0002ad20 con 0x7f2d14159ca0 2024-08-17T02:29:15.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.873+0000 7f2d12a00640 1 -- 172.21.15.110:0/2930441542 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0002ae80 con 0x7f2d14159ca0 2024-08-17T02:29:15.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.873+0000 7f2d12a00640 1 -- 172.21.15.110:0/2930441542 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00032670 con 0x7f2d14159ca0 2024-08-17T02:29:15.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.873+0000 7fce5f200640 1 Processor -- start 2024-08-17T02:29:15.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.873+0000 7fce5f200640 1 -- start start 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f8855c00640 1 Processor -- start 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.872+0000 7f19a9e00640 1 -- 172.21.15.110:0/3301376633 >> v1:172.21.15.177:6789/0 conn(0x7f19ac15d610 legacy=0x7f19ac097c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.872+0000 7f19a9e00640 1 -- 172.21.15.110:0/3301376633 >> v1:172.21.15.110:6789/0 conn(0x7f19ac0b4020 legacy=0x7f19ac15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.872+0000 7f19a9400640 1 -- 172.21.15.110:0/3301376633 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544384462 0 0) 0x7f19ac0b44a0 con 0x7f19ac0b4020 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.872+0000 7f19a9e00640 1 -- 172.21.15.110:0/3301376633 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0c4f00 con 0x7f19ac0c6250 2024-08-17T02:29:15.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 -- 172.21.15.110:0/2930441542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d14159ca0 msgr2=0x7f2d140ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d14159ca0 0x7f2d140ca360 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d1408a060 tx=0x7f2d000090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f19a9e00640 1 --2- 172.21.15.110:0/3301376633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac0c6620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f199c009e60 tx=0x7f199c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c531b74f7130063e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 -- 172.21.15.110:0/2930441542 shutdown_connections 2024-08-17T02:29:15.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f8855c00640 1 -- start start 2024-08-17T02:29:15.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ccad0 0x7f2d140cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 --2- 172.21.15.110:0/2930441542 >> v2:172.21.15.177:3300/0 conn(0x7f2d140ca8a0 0x7f2d140cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 --2- 172.21.15.110:0/2930441542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d14159ca0 0x7f2d140ca360 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.874+0000 7f2d19c00640 1 -- 172.21.15.110:0/2930441542 >> 172.21.15.110:0/2930441542 conn(0x7f2d14098e00 msgr2=0x7f2d1406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7f19a9400640 1 -- 172.21.15.110:0/3301376633 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c007550 con 0x7f19ac0c6250 2024-08-17T02:29:15.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7f19a9400640 1 -- 172.21.15.110:0/3301376633 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c02d050 con 0x7f19ac0c6250 2024-08-17T02:29:15.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7f19a9400640 1 -- 172.21.15.110:0/3301376633 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c007900 con 0x7f19ac0c6250 2024-08-17T02:29:15.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7f2d19c00640 1 -- 172.21.15.110:0/2930441542 shutdown_connections 2024-08-17T02:29:15.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7fce5f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce58038b50 0x7fce58038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7fce5f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce580378a0 0x7fce58037d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7fce5f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce58007a30 con 0x7fce580e2020 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7fce5f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce58039510 con 0x7fce58038b50 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7fce5f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce58006e20 con 0x7fce580378a0 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7f2d19c00640 1 -- 172.21.15.110:0/2930441542 wait complete. 2024-08-17T02:29:15.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.875+0000 7ff105000640 1 Processor -- start 2024-08-17T02:29:15.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 -- 172.21.15.110:0/3301376633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 msgr2=0x7f19ac0c6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 --2- 172.21.15.110:0/3301376633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac0c6620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f199c009e60 tx=0x7f199c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:15.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 -- 172.21.15.110:0/3301376633 shutdown_connections 2024-08-17T02:29:15.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 --2- 172.21.15.110:0/3301376633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac0c6620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 -- 172.21.15.110:0/3301376633 >> 172.21.15.110:0/3301376633 conn(0x7f19ac0cfde0 msgr2=0x7f19ac0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7faded400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fade80afed0 0x7fade81565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7faded400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade8159900 con 0x7fade806e570 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7faded400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade81590e0 con 0x7fade8156130 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7faded400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade8159340 con 0x7fade80afed0 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 -- 172.21.15.110:0/3301376633 shutdown_connections 2024-08-17T02:29:15.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7f19b0a00640 1 -- 172.21.15.110:0/3301376633 wait complete. 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7fce5de00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fce580e2020 0x7fce5803aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41346/0 (socket says 172.21.15.110:41346) 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7fce5de00640 1 -- 172.21.15.110:0/586326860 learned_addr learned my addr 172.21.15.110:0/586326860 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7fce5e800640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce580378a0 0x7fce58037d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7fce5d400640 1 --2- 172.21.15.110:0/586326860 >> v2:172.21.15.110:3300/0 conn(0x7fce58038b50 0x7fce58038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177706420 0 0) 0x7fce58007a30 con 0x7fce580e2020 2024-08-17T02:29:15.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce440034e0 con 0x7fce580e2020 2024-08-17T02:29:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7f8855c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88480e09f0 0x7f884804f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.877+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1925087565 0 0) 0x7fce440034e0 con 0x7fce580e2020 2024-08-17T02:29:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce580378a0 msgr2=0x7fce58037d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce580378a0 0x7fce58037d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 >> v2:172.21.15.110:3300/0 conn(0x7fce58038b50 msgr2=0x7fce58038fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fade7e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fade806e570 0x7fade81589d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41350/0 (socket says 172.21.15.110:41350) 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fade7e00640 1 -- 172.21.15.110:0/754380097 learned_addr learned my addr 172.21.15.110:0/754380097 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f8855c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f884804ff20 0x7f8848005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f8855c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8848006440 0x7f88480ea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f8855c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88480375b0 con 0x7f884804ff20 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f8855c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8848006c30 con 0x7f88480e09f0 2024-08-17T02:29:15.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f8855c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848006f10 con 0x7f8848006440 2024-08-17T02:29:15.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7f19b0a00640 1 Processor -- start 2024-08-17T02:29:15.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.876+0000 7ff105000640 1 -- start start 2024-08-17T02:29:15.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f19b0a00640 1 -- start start 2024-08-17T02:29:15.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7ff105000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 0x7ff1000adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7ff105000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7ff105000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1000af6e0 con 0x7ff10006a410 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7ff105000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10006a890 con 0x7ff10013e360 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7ff105000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1000acb40 con 0x7ff10013e730 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 --2- 172.21.15.110:0/586326860 >> v2:172.21.15.110:3300/0 conn(0x7fce58038b50 0x7fce58038fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58007100 con 0x7fce580e2020 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fce50001470 con 0x7fce580e2020 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 >> v1:172.21.15.110:6789/0 conn(0x7fce580e2020 legacy=0x7fce5803aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce44003a50 0x7fce44003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce44004780 0x7fce44004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44005130 0x7fce4400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce58039510 con 0x7fce44004780 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce58006e20 con 0x7fce44003a50 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.878+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4400c040 con 0x7fce44005130 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f884804ff20 0x7f8848005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f884804ff20 0x7f8848005f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48946/0 (socket says 172.21.15.110:48946) 2024-08-17T02:29:15.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 -- 172.21.15.110:0/2845602304 learned_addr learned my addr 172.21.15.110:0/2845602304 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7ff0fd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7ff0fd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51660/0 (socket says 172.21.15.110:51660) 2024-08-17T02:29:15.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7ff0fd400640 1 -- 172.21.15.110:0/2747935798 learned_addr learned my addr 172.21.15.110:0/2747935798 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884fe00640 1 --2- 172.21.15.110:0/2845602304 >> v2:172.21.15.177:3300/0 conn(0x7f88480e09f0 0x7f884804f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 -- 172.21.15.110:0/2845602304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8848006440 msgr2=0x7f88480ea010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7fce5d400640 1 --2- 172.21.15.110:0/586326860 >> v2:172.21.15.110:3300/0 conn(0x7fce58038b50 0x7fce58038fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5e800640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44005130 0x7fce4400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce44003a50 0x7fce44003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 --2- 172.21.15.110:0/2845602304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8848006440 0x7f88480ea010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 -- 172.21.15.110:0/2845602304 >> v2:172.21.15.177:3300/0 conn(0x7f88480e09f0 msgr2=0x7f884804f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 --2- 172.21.15.110:0/2845602304 >> v2:172.21.15.177:3300/0 conn(0x7f88480e09f0 0x7f884804f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.879+0000 7f884f400640 1 -- 172.21.15.110:0/2845602304 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480071f0 con 0x7f884804ff20 2024-08-17T02:29:15.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446556803 0 0) 0x7fade81590e0 con 0x7fade8156130 2024-08-17T02:29:15.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7f2d19c00640 1 Processor -- start 2024-08-17T02:29:15.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadcc0034e0 con 0x7fade8156130 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 -- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44005130 msgr2=0x7fce4400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44005130 0x7fce4400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 -- 172.21.15.110:0/586326860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce44004780 msgr2=0x7fce44004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce44004780 0x7fce44004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fce5de00640 1 -- 172.21.15.110:0/586326860 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58007100 con 0x7fce44003a50 2024-08-17T02:29:15.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fadeca00640 1 --2- 172.21.15.110:0/754380097 >> v2:172.21.15.177:3300/0 conn(0x7fade80afed0 0x7fade81565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7ff0fd400640 1 -- 172.21.15.110:0/2747935798 >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 msgr2=0x7ff1000adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7ff0fde00640 1 --2- 172.21.15.110:0/2747935798 >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 0x7ff1000adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7ff0fd400640 1 --2- 172.21.15.110:0/2747935798 >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 0x7ff1000adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7ff0fd400640 1 -- 172.21.15.110:0/2747935798 >> v1:172.21.15.177:6789/0 conn(0x7ff10006a410 legacy=0x7ff1000aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7ff0fd400640 1 -- 172.21.15.110:0/2747935798 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1000ad6c0 con 0x7ff10013e730 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7ff0fca00640 1 -- 172.21.15.110:0/2747935798 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192620272 0 0) 0x7ff1000af6e0 con 0x7ff10006a410 2024-08-17T02:29:15.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073058486 0 0) 0x7fade8159900 con 0x7fade806e570 2024-08-17T02:29:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.880+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fade81590e0 con 0x7fade806e570 2024-08-17T02:29:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542654002 0 0) 0x7fadcc0034e0 con 0x7fade8156130 2024-08-17T02:29:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7f19b0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 >> v2:172.21.15.177:3300/0 conn(0x7fade80afed0 msgr2=0x7fade81565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 --2- 172.21.15.110:0/754380097 >> v2:172.21.15.177:3300/0 conn(0x7fade80afed0 0x7fade81565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 >> v1:172.21.15.110:6789/0 conn(0x7fade806e570 legacy=0x7fade81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7f19b0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7ff0fde00640 1 --2- 172.21.15.110:0/2747935798 >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 0x7ff1000adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8159620 con 0x7fade8156130 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fadd8001470 con 0x7fade8156130 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 >> v1:172.21.15.177:6789/0 conn(0x7fade8156130 legacy=0x7fade80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fadcc003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004780 0x7fadcc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc005130 0x7fadcc0145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8159340 con 0x7fadcc003b60 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc009c40 con 0x7fadcc004780 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc014b10 con 0x7fadcc005130 2024-08-17T02:29:15.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.881+0000 7f884f400640 1 --2- 172.21.15.110:0/2845602304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f8848005f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f884800d4c0 tx=0x7f88440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e11dbc654a28890 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19a9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19b0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19a9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51694/0 (socket says 172.21.15.110:51694) 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19a1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f884ea00640 1 -- 172.21.15.110:0/2845602304 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884402acc0 con 0x7f884804ff20 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f884ea00640 1 -- 172.21.15.110:0/2845602304 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884402ae20 con 0x7f884804ff20 2024-08-17T02:29:15.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f884ea00640 1 -- 172.21.15.110:0/2845602304 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844032670 con 0x7f884804ff20 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7fadeca00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc005130 0x7fadcc0145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7fade7e00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fadcc003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7fade7400640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004780 0x7fadcc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19a1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56318/0 (socket says 172.21.15.110:56318) 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f19aa800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f19aa800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:48978/0 (socket says 172.21.15.110:48978) 2024-08-17T02:29:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.882+0000 7f2d19c00640 1 -- start start 2024-08-17T02:29:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f19a9e00640 1 -- 172.21.15.110:0/377703109 learned_addr learned my addr 172.21.15.110:0/377703109 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac09a910 con 0x7f19ac15d610 2024-08-17T02:29:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac099d00 con 0x7f19ac0c6250 2024-08-17T02:29:15.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac099fe0 con 0x7f19ac0b4020 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f2d19c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 0x7f2d1409bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f2d19c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140ccad0 0x7f2d1416c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7f2d19c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 0x7f2d140ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d19c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1409c6d0 con 0x7f2d140ccad0 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d19c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1409c9b0 con 0x7f2d14159ca0 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7ff0fd400640 1 --2- 172.21.15.110:0/2747935798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec008920 tx=0x7ff0ec008240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d96be1df0dd948 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7ff0fca00640 1 -- 172.21.15.110:0/2747935798 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec032050 con 0x7ff10013e730 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 -- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 msgr2=0x7f19ac156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 -- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 msgr2=0x7f19ac09afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009a20 con 0x7f19ac0b4020 2024-08-17T02:29:15.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d19c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1409cc90 con 0x7f2d140ca8a0 2024-08-17T02:29:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 -- 172.21.15.110:0/2845602304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 msgr2=0x7f8848005f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 --2- 172.21.15.110:0/2845602304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f8848005f00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f884800d4c0 tx=0x7f88440091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7ff0fca00640 1 -- 172.21.15.110:0/2747935798 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec033460 con 0x7ff10013e730 2024-08-17T02:29:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7ff0fca00640 1 -- 172.21.15.110:0/2747935798 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec032050 con 0x7ff10013e730 2024-08-17T02:29:15.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 0x7f2d1409bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19aa800640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 -- 172.21.15.110:0/2845602304 shutdown_connections 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 --2- 172.21.15.110:0/2845602304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8848006440 0x7f88480ea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 --2- 172.21.15.110:0/2845602304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f8848005f00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 --2- 172.21.15.110:0/2845602304 >> v2:172.21.15.177:3300/0 conn(0x7f88480e09f0 0x7f884804f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 -- 172.21.15.110:0/2845602304 >> 172.21.15.110:0/2845602304 conn(0x7f8848009fa0 msgr2=0x7f884800a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7fade7e00640 1 -- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc005130 msgr2=0x7fadcc0145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7fade7e00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadcc005130 0x7fadcc0145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7fade7e00640 1 -- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004780 msgr2=0x7fadcc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7fade7e00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadcc004780 0x7fadcc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.883+0000 7fade7e00640 1 -- 172.21.15.110:0/754380097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8159620 con 0x7fadcc003b60 2024-08-17T02:29:15.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7fce5de00640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce44003a50 0x7fce44003e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c350 tx=0x7fce5002a8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=648b28a1c606128f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f19a9e00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f199c0097c0 tx=0x7f199c037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f3d33a00640 1 Processor -- start 2024-08-17T02:29:15.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7fadeca00640 1 -- 172.21.15.110:0/754380097 reap_dead start 2024-08-17T02:29:15.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f8855c00640 1 -- 172.21.15.110:0/2845602304 shutdown_connections 2024-08-17T02:29:15.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 0x7f2d1409bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51700/0 (socket says 172.21.15.110:51700) 2024-08-17T02:29:15.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d13e00640 1 -- 172.21.15.110:0/3112468592 learned_addr learned my addr 172.21.15.110:0/3112468592 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.884+0000 7f2d13400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140ccad0 0x7f2d1416c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5002d070 con 0x7fce44003a50 2024-08-17T02:29:15.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f2d19200640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 0x7f2d140ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7fade7e00640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fadcc003f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001a40 tx=0x7fadd4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f444352b02f02c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c031b90 con 0x7f19ac0b4020 2024-08-17T02:29:15.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac09a2c0 con 0x7f19ac0b4020 2024-08-17T02:29:15.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7ff105000640 1 -- 172.21.15.110:0/2747935798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 msgr2=0x7ff100069ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7ff105000640 1 --2- 172.21.15.110:0/2747935798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec008920 tx=0x7ff0ec008240 comp rx=0 tx=0).stop 2024-08-17T02:29:15.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c031cf0 con 0x7f19ac0b4020 2024-08-17T02:29:15.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c031b90 con 0x7f19ac0b4020 2024-08-17T02:29:15.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac099990 con 0x7f19ac0b4020 2024-08-17T02:29:15.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd402ab50 con 0x7fadcc003b60 2024-08-17T02:29:15.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7fade6a00640 1 -- 172.21.15.110:0/754380097 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd402acd0 con 0x7fadcc003b60 2024-08-17T02:29:15.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f8855c00640 1 -- 172.21.15.110:0/2845602304 wait complete. 2024-08-17T02:29:15.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f2d19200640 1 -- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 msgr2=0x7f2d1409bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f2d19200640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 0x7f2d1409bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7f2d19200640 1 -- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140ccad0 msgr2=0x7f2d1416c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7f2d19200640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140ccad0 0x7f2d1416c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7f2d19200640 1 -- 172.21.15.110:0/3112468592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d00009390 con 0x7f2d14159ca0 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50005890 con 0x7fce44003a50 2024-08-17T02:29:15.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7fce5ca00640 1 -- 172.21.15.110:0/586326860 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50005cd0 con 0x7fce44003a50 2024-08-17T02:29:15.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.885+0000 7f3d33a00640 1 -- start start 2024-08-17T02:29:15.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7f2d19200640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 0x7f2d140ce9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c007ed0 tx=0x7f2d0c009850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c018070 con 0x7f2d14159ca0 2024-08-17T02:29:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7ff105000640 1 -- 172.21.15.110:0/2747935798 shutdown_connections 2024-08-17T02:29:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7ff105000640 1 --2- 172.21.15.110:0/2747935798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100069ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7ff105000640 1 --2- 172.21.15.110:0/2747935798 >> v2:172.21.15.110:3300/0 conn(0x7ff10013e360 0x7ff1000adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7ff105000640 1 -- 172.21.15.110:0/2747935798 >> 172.21.15.110:0/2747935798 conn(0x7ff1000cc480 msgr2=0x7ff1000687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.886+0000 7ff105000640 1 -- 172.21.15.110:0/2747935798 shutdown_connections 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00ee30 con 0x7f2d14159ca0 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c014650 con 0x7f2d14159ca0 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1409cf70 con 0x7f2d14159ca0 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1409c330 con 0x7f2d14159ca0 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7faded400640 1 -- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 msgr2=0x7fadcc003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7faded400640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fadcc003f50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fadd4001a40 tx=0x7fadd4007d90 comp rx=0 tx=0).stop 2024-08-17T02:29:15.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f3d33a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d2c15d830 0x7f3d2c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f8855c00640 1 Processor -- start 2024-08-17T02:29:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7ff105000640 1 -- 172.21.15.110:0/2747935798 wait complete. 2024-08-17T02:29:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f3d33a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f8855c00640 1 -- start start 2024-08-17T02:29:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f3d33a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0b1690 con 0x7f3d2c0b0610 2024-08-17T02:29:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f3d33a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b1b20 con 0x7f3d2c15d830 2024-08-17T02:29:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.887+0000 7f3d33a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c0ae4a0 con 0x7f3d2c15e310 2024-08-17T02:29:15.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f3d31a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7faded400640 1 -- 172.21.15.110:0/754380097 shutdown_connections 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7faded400640 1 --2- 172.21.15.110:0/754380097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fadcc003f50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7faded400640 1 -- 172.21.15.110:0/754380097 >> 172.21.15.110:0/754380097 conn(0x7fade80cb790 msgr2=0x7fade80cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7fce5f200640 1 -- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce44003a50 msgr2=0x7fce44003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7fce5f200640 1 --2- 172.21.15.110:0/586326860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce44003a50 0x7fce44003e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c350 tx=0x7fce5002a8d0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7fce5e800640 1 -- 172.21.15.110:0/586326860 reap_dead start 2024-08-17T02:29:15.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f199c003040 con 0x7f19ac0b4020 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac063d20 con 0x7f19ac0b4020 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f3d31000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d2c15d830 0x7f3d2c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f3d31a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51712/0 (socket says 172.21.15.110:51712) 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.888+0000 7f3d31a00640 1 -- 172.21.15.110:0/1513501508 learned_addr learned my addr 172.21.15.110:0/1513501508 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f3d31a00640 1 -- 172.21.15.110:0/1513501508 >> v2:172.21.15.110:3300/0 conn(0x7f3d2c15d830 msgr2=0x7f3d2c06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f3d31a00640 1 --2- 172.21.15.110:0/1513501508 >> v2:172.21.15.110:3300/0 conn(0x7f3d2c15d830 0x7f3d2c06e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f3d31a00640 1 -- 172.21.15.110:0/1513501508 >> v1:172.21.15.177:6789/0 conn(0x7f3d2c0b0610 legacy=0x7f3d2c15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f3d31a00640 1 -- 172.21.15.110:0/1513501508 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c15b200 con 0x7f3d2c15e310 2024-08-17T02:29:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7faded400640 1 -- 172.21.15.110:0/754380097 shutdown_connections 2024-08-17T02:29:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f19a2000640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 0x7f19880676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7faded400640 1 -- 172.21.15.110:0/754380097 wait complete. 2024-08-17T02:29:15.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.889+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f199c0a3ba0 con 0x7f19ac0b4020 2024-08-17T02:29:15.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7f8855c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 0x7f88480d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7f19a1400640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 0x7f19880676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7fce5f200640 1 -- 172.21.15.110:0/586326860 shutdown_connections 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7fce5f200640 1 -- 172.21.15.110:0/586326860 >> 172.21.15.110:0/586326860 conn(0x7fce5800f050 msgr2=0x7fce58058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7fce5f200640 1 -- 172.21.15.110:0/586326860 shutdown_connections 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7f8855c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7f8855c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88480e09f0 0x7f884804a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7fce5f200640 1 -- 172.21.15.110:0/586326860 wait complete. 2024-08-17T02:29:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f3d31a00640 1 --2- 172.21.15.110:0/1513501508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009910 tx=0x7f3d1c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d7c6d1291db486 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.890+0000 7f884fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 0x7f88480d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f884f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f884f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49002/0 (socket says 172.21.15.110:49002) 2024-08-17T02:29:15.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f8855c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480e1230 con 0x7f884804ff20 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f884f400640 1 -- 172.21.15.110:0/18188726 learned_addr learned my addr 172.21.15.110:0/18188726 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848038a50 con 0x7f8848006440 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8848038160 con 0x7f88480e09f0 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7ff105000640 1 Processor -- start 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f8855200640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88480e09f0 0x7f884804a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f19a1400640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 0x7f19880676e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19ac06e5f0 tx=0x7f1994007f90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1409d470 con 0x7f2d14159ca0 2024-08-17T02:29:15.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2d0c003020 con 0x7f2d14159ca0 2024-08-17T02:29:15.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.891+0000 7faded400640 1 Processor -- start 2024-08-17T02:29:15.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 -- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88480e09f0 msgr2=0x7f884804a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88480e09f0 0x7f884804a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 -- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 msgr2=0x7f88480d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7ff105000640 1 -- start start 2024-08-17T02:29:15.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7faded400640 1 -- start start 2024-08-17T02:29:15.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 0x7f88480d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009450 con 0x7f884804ff20 2024-08-17T02:29:15.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884fe00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 0x7f88480d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.892+0000 7f884f400640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8844009940 tx=0x7f8844032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fade8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031780 con 0x7f884804ff20 2024-08-17T02:29:15.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7f2d0b400640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 0x7f2cf4067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade814ce90 con 0x7fadcc003b60 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade8168320 con 0x7fade814c360 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7faded400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade8168600 con 0x7fade814a7e0 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fade7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d0c0826f0 con 0x7f2d14159ca0 2024-08-17T02:29:15.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fadeca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fade7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51736/0 (socket says 172.21.15.110:51736) 2024-08-17T02:29:15.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fadeca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56358/0 (socket says 172.21.15.110:56358) 2024-08-17T02:29:15.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fade7400640 1 -- 172.21.15.110:0/4213294554 learned_addr learned my addr 172.21.15.110:0/4213294554 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fce5f200640 1 Processor -- start 2024-08-17T02:29:15.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7fc055e00640 1 Processor -- start 2024-08-17T02:29:15.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fce5f200640 1 -- start start 2024-08-17T02:29:15.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fc055e00640 1 -- start start 2024-08-17T02:29:15.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7f2d13e00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 0x7f2cf4067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fade7e00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fade8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 -- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 msgr2=0x7fade814c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 -- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 msgr2=0x7fade8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fade8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 -- 172.21.15.110:0/4213294554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade81688e0 con 0x7fade814c360 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fade7e00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fade8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fade7400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:15.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.893+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88440318e0 con 0x7f884804ff20 2024-08-17T02:29:15.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844031ca0 con 0x7f884804ff20 2024-08-17T02:29:15.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88480d1390 con 0x7f884804ff20 2024-08-17T02:29:15.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7fadeca00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fade80646a0 tx=0x7fade0009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7ff105000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8848038400 con 0x7f884804ff20 2024-08-17T02:29:15.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.894+0000 7ff105000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 0x7ff1001546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff105000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff105000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10013ad00 con 0x7ff10013e360 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff105000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10013afe0 con 0x7ff10006a410 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff105000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10013b2c0 con 0x7ff10013e730 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff0fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff0fde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56374/0 (socket says 172.21.15.110:56374) 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff0fde00640 1 -- 172.21.15.110:0/1042439699 learned_addr learned my addr 172.21.15.110:0/1042439699 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5804d360 0x7fce5803cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff0fd400640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 0x7ff1001546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7f2d13e00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 0x7f2cf4067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009310 tx=0x7f2d00032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7ff0fe800640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc055e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc0500c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc055e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc050159430 0x7fc0500cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc055e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0500cbf40 con 0x7fc0500c6a30 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc055e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0500cb930 con 0x7fc050159430 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc055e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500ced10 con 0x7fc050159060 2024-08-17T02:29:15.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce5803d3e0 0x7fce5804ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce58051400 con 0x7fce5803d3e0 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8848038bc0 con 0x7f884804ff20 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5803d850 con 0x7fce5804d360 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.895+0000 7fce5f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce580d0910 con 0x7fce44003a50 2024-08-17T02:29:15.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51758/0 (socket says 172.21.15.110:51758) 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 -- 172.21.15.110:0/394869693 learned_addr learned my addr 172.21.15.110:0/394869693 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5d400640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5804d360 0x7fce5803cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fde00640 1 -- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 msgr2=0x7ff100156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5e800640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce5803d3e0 0x7fce5804ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fde00640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fde00640 1 -- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 msgr2=0x7ff1001546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fde00640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 0x7ff1001546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fde00640 1 -- 172.21.15.110:0/1042439699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0084e0 con 0x7ff10006a410 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc04f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc050159430 0x7fc0500cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc04ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc0500c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc04e000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc0500c6a30 0x7fc0500cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:39656/0 (socket says 172.21.15.110:39656) 2024-08-17T02:29:15.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fc04e000640 1 -- 172.21.15.110:0/2831519707 learned_addr learned my addr 172.21.15.110:0/2831519707 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:15.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fd400640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 0x7ff1001546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7ff0fe800640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 -- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5804d360 msgr2=0x7fce5803cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5804d360 0x7fce5803cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 -- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce5803d3e0 msgr2=0x7fce5804ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce5803d3e0 0x7fce5804ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.896+0000 7fce5de00640 1 -- 172.21.15.110:0/394869693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5804f470 con 0x7fce44003a50 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7ff0fde00640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c880 tx=0x7ff0f0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7fc04f400640 1 -- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 msgr2=0x7fc0500c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:15.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f884403c610 con 0x7f884804ff20 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7fce5de00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c3b0 tx=0x7fce50034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7fc04f400640 1 --2- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc0500c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7fc04f400640 1 -- 172.21.15.110:0/2831519707 >> v1:172.21.15.177:6789/0 conn(0x7fc0500c6a30 legacy=0x7fc0500cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.897+0000 7fc04f400640 1 -- 172.21.15.110:0/2831519707 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500cbbd0 con 0x7fc050159430 2024-08-17T02:29:15.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.898+0000 7f883f400640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 0x7f8834067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.898+0000 7fc04f400640 1 --2- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc050159430 0x7fc0500cb2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc038009850 tx=0x7fc0380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5397392c8c36f2b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.898+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88440a2bc0 con 0x7f884804ff20 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.898+0000 7f884fe00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 0x7f8834067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.899+0000 7f884fe00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 0x7f8834067600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88480345f0 tx=0x7f8840008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.900+0000 7f3d2b400640 1 -- 172.21.15.110:0/1513501508 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c02adb0 con 0x7f3d2c15e310 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.900+0000 7f3d2b400640 1 -- 172.21.15.110:0/1513501508 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c032440 con 0x7f3d2c15e310 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.900+0000 7f3d2b400640 1 -- 172.21.15.110:0/1513501508 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c02adb0 con 0x7f3d2c15e310 2024-08-17T02:29:15.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.900+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50005d20 con 0x7fce44003a50 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50005e80 con 0x7fce44003a50 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50031640 con 0x7fce44003a50 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7fce5f200640 1 -- 172.21.15.110:0/394869693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5804e860 con 0x7fce44003a50 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7fce5f200640 1 -- 172.21.15.110:0/394869693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5804ee20 con 0x7fce44003a50 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f199c071c70 con 0x7f19ac0b4020 2024-08-17T02:29:15.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7f3d33a00640 1 -- 172.21.15.110:0/1513501508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 msgr2=0x7f3d2c166e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.901+0000 7f3d33a00640 1 --2- 172.21.15.110:0/1513501508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009910 tx=0x7f3d1c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7f3d33a00640 1 -- 172.21.15.110:0/1513501508 shutdown_connections 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7f3d33a00640 1 --2- 172.21.15.110:0/1513501508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c15e310 0x7f3d2c166e50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7f3d33a00640 1 --2- 172.21.15.110:0/1513501508 >> v2:172.21.15.110:3300/0 conn(0x7f3d2c15d830 0x7f3d2c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7f3d33a00640 1 -- 172.21.15.110:0/1513501508 >> 172.21.15.110:0/1513501508 conn(0x7f3d2c0cb9b0 msgr2=0x7f3d2c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000ce10 con 0x7ff10006a410 2024-08-17T02:29:15.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10013b5a0 con 0x7ff10006a410 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7fce5f200640 1 -- 172.21.15.110:0/394869693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce58005770 con 0x7fce44003a50 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7fc04d600640 1 -- 172.21.15.110:0/2831519707 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03802ad00 con 0x7fc050159430 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7fc04d600640 1 -- 172.21.15.110:0/2831519707 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03802ae60 con 0x7fc050159430 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7fc04d600640 1 -- 172.21.15.110:0/2831519707 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038032670 con 0x7fc050159430 2024-08-17T02:29:15.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7f3d33a00640 1 -- 172.21.15.110:0/1513501508 shutdown_connections 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0009b10 con 0x7fade814c360 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0002740 con 0x7fade814c360 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0002b00 con 0x7fade814c360 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff100154c00 con 0x7ff10006a410 2024-08-17T02:29:15.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.902+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2d0c050710 con 0x7f2d14159ca0 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7fc055e00640 1 -- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc050159430 msgr2=0x7fc0500cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7fc055e00640 1 --2- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc050159430 0x7fc0500cb2d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc038009850 tx=0x7fc0380090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7f3d33a00640 1 -- 172.21.15.110:0/1513501508 wait complete. 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 -- 172.21.15.110:0/2831519707 shutdown_connections 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 --2- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc050159430 0x7fc0500cb2d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 --2- 172.21.15.110:0/2831519707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc0500c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 -- 172.21.15.110:0/2831519707 >> 172.21.15.110:0/2831519707 conn(0x7fc0500cfde0 msgr2=0x7fc0500d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 -- 172.21.15.110:0/2831519707 shutdown_connections 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7fc055e00640 1 -- 172.21.15.110:0/2831519707 wait complete. 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade8168bc0 con 0x7fade814c360 2024-08-17T02:29:15.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.903+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade81540d0 con 0x7fade814c360 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f0007890 con 0x7ff10006a410 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0007c10 con 0x7ff10006a410 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.904+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8844070be0 con 0x7f884804ff20 2024-08-17T02:29:15.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.905+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fce50038070 con 0x7fce44003a50 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7f3d33a00640 1 Processor -- start 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.907+0000 7fce55600640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 0x7fce40067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.907+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce500a2920 con 0x7fce44003a50 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8005210 con 0x7ff10006a410 2024-08-17T02:29:15.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7fc055e00640 1 Processor -- start 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7fc055e00640 1 -- start start 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc0005210 con 0x7fade814c360 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc05015b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 0x7fc0500b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.906+0000 7f3d33a00640 1 -- start start 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 0x7f3d2c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 0x7f3d2c14e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c14e2a0 con 0x7f3d2c15d830 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c163d50 con 0x7f3d2c15e310 2024-08-17T02:29:15.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7f3d33a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1506e0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050159840 con 0x7fc050159430 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05015bd50 con 0x7fc0500c6a30 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7fc055e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc050159a50 con 0x7fc050159060 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56402/0 (socket says 172.21.15.110:56402) 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 -- 172.21.15.110:0/1674825529 learned_addr learned my addr 172.21.15.110:0/1674825529 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04e000640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc05015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7f3d31000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fce5d400640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 0x7fce40067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7f3d31000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51784/0 (socket says 172.21.15.110:51784) 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7f3d31000640 1 -- 172.21.15.110:0/608489748 learned_addr learned my addr 172.21.15.110:0/608489748 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04f400640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 0x7fc0500b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 -- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 msgr2=0x7fc05015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc05015b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 -- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 msgr2=0x7fc0500b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7f3d31a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 0x7f3d2c14e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 0x7fc0500b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.909+0000 7fc04ea00640 1 -- 172.21.15.110:0/1674825529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009390 con 0x7fc0500c6a30 2024-08-17T02:29:15.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7fc04f400640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 0x7fc0500b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d31000640 1 -- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 msgr2=0x7f3d2c14e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d31000640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 0x7f3d2c14e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d31000640 1 -- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 msgr2=0x7f3d2c14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7fce5d400640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 0x7fce40067780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce5803e640 tx=0x7fce4c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fade0003040 con 0x7fade814c360 2024-08-17T02:29:15.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7faddf400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 0x7fadc80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fade0082250 con 0x7fade814c360 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7fc04ea00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc048007f60 tx=0x7fc048009860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d2be00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 0x7f3d2c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d31a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 0x7f3d2c14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:15.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.908+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff0f00113f0 con 0x7ff10006a410 2024-08-17T02:29:15.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.910+0000 7f3d31000640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 0x7f3d2c14d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:15.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7fade7e00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 0x7fadc80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7f3d31000640 1 -- 172.21.15.110:0/608489748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c009450 con 0x7f3d2c0b0610 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7f3d2be00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 0x7f3d2c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7f3d31000640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009ef0 tx=0x7f3d2400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7ff0f5600640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 0x7ff0e0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff0f00824c0 con 0x7ff10006a410 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.911+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400cdb0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2400f040 con 0x7f3d2c0b0610 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240146b0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c14fad0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c150090 con 0x7f3d2c0b0610 2024-08-17T02:29:15.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7ff0fd400640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 0x7ff0e0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.912+0000 7fade7e00640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 0x7fadc80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fadd4032000 tx=0x7fadd402f000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.913+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fce500709c0 con 0x7fce44003a50 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.913+0000 7ff0fd400640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 0x7ff0e0067680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec038000 tx=0x7ff0ec03b000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.914+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c064db0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.914+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3d24014a20 con 0x7f3d2c0b0610 2024-08-17T02:29:15.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.915+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff0f0053f70 con 0x7ff10006a410 2024-08-17T02:29:15.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.915+0000 7f3d23e00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 0x7f3d0c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.916+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d24082ef0 con 0x7f3d2c0b0610 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.916+0000 7f3d2be00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 0x7f3d0c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.917+0000 7f3d2be00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 0x7f3d0c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c14f4c0 tx=0x7f3d18008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.924+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3d24050f90 con 0x7f3d2c0b0610 2024-08-17T02:29:15.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.925+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fade00503b0 con 0x7fade814c360 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.925+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800ee30 con 0x7fc0500c6a30 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.925+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc048014420 con 0x7fc0500c6a30 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.925+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0480147e0 con 0x7fc0500c6a30 2024-08-17T02:29:15.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.925+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc050159d30 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.926+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05015b990 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.928+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc050063d20 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.933+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc048014b50 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.935+0000 7fc046000640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 0x7fc02c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.935+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0480836c0 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.936+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc048083ab0 con 0x7fc0500c6a30 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.936+0000 7fc04e000640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 0x7fc02c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:15.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:15.939+0000 7fc04e000640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 0x7fc02c067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc05015cf40 tx=0x7fc040009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:16.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.301+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d14071050 con 0x7f2d14159ca0 2024-08-17T02:29:16.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.301+0000 7f2d0b400640 1 -- 172.21.15.110:0/3112468592 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d0c001250 con 0x7f2d14159ca0 2024-08-17T02:29:16.303 INFO:teuthology.orchestra.run.smithi110.stdout:60129542147 2024-08-17T02:29:16.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.305+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 msgr2=0x7f2cf4067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.305+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 0x7f2cf4067680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009310 tx=0x7f2d00032000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.305+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 msgr2=0x7f2d140ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.305+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 0x7f2d140ce9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c007ed0 tx=0x7f2d0c009850 comp rx=0 tx=0).stop 2024-08-17T02:29:16.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 shutdown_connections 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2cf40651d0 0x7f2cf4067680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d14159ca0 0x7f2d140ce9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d140ccad0 0x7f2d1416c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 --2- 172.21.15.110:0/3112468592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d140ca8a0 0x7f2d1409bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.306+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 >> 172.21.15.110:0/3112468592 conn(0x7f2d14098e00 msgr2=0x7f2d140689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.307+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 shutdown_connections 2024-08-17T02:29:16.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.307+0000 7f2d19c00640 1 -- 172.21.15.110:0/3112468592 wait complete. 2024-08-17T02:29:16.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.311+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19ac0b3e00 con 0x7f19ac0b4020 2024-08-17T02:29:16.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.312+0000 7f19a2000640 1 -- 172.21.15.110:0/377703109 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f199c04a070 con 0x7f19ac0b4020 2024-08-17T02:29:16.313 INFO:teuthology.orchestra.run.smithi110.stdout:60129542147 2024-08-17T02:29:16.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.313+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8848005320 con 0x7f884804ff20 2024-08-17T02:29:16.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.314+0000 7f883f400640 1 -- 172.21.15.110:0/18188726 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8844049020 con 0x7f884804ff20 2024-08-17T02:29:16.316 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:16.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.316+0000 7fce5f200640 1 -- 172.21.15.110:0/394869693 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce58004f70 con 0x7fce44003a50 2024-08-17T02:29:16.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.316+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 msgr2=0x7f19880676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 0x7f19880676e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19ac06e5f0 tx=0x7f1994007f90 comp rx=0 tx=0).stop 2024-08-17T02:29:16.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7fce55600640 1 -- 172.21.15.110:0/394869693 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce50073fe0 con 0x7fce44003a50 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 msgr2=0x7f19ac09d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f199c0097c0 tx=0x7f199c037000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 shutdown_connections 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1988065230 0x7f19880676e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19ac15d610 0x7f19ac09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19ac0c6250 0x7f19ac156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 --2- 172.21.15.110:0/377703109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19ac0b4020 0x7f19ac09d150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.317+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 >> 172.21.15.110:0/377703109 conn(0x7f19ac0cfde0 msgr2=0x7f19ac06e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 shutdown_connections 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f19b0a00640 1 -- 172.21.15.110:0/377703109 wait complete. 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 msgr2=0x7f8834067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 0x7f8834067600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f88480345f0 tx=0x7f8840008040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 msgr2=0x7f88480f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.318+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8844009940 tx=0x7f8844032000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 shutdown_connections 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8834065150 0x7f8834067600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88480e09f0 0x7f884804a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f884804ff20 0x7f88480f7340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 --2- 172.21.15.110:0/18188726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8848006440 0x7f88480d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 >> 172.21.15.110:0/18188726 conn(0x7f8848009fa0 msgr2=0x7f884800a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 shutdown_connections 2024-08-17T02:29:16.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.319+0000 7f8855c00640 1 -- 172.21.15.110:0/18188726 wait complete. 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.320+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 msgr2=0x7fce40067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.320+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 0x7fce40067780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fce5803e640 tx=0x7fce4c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.320+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 msgr2=0x7fce580d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.320+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fce5000c3b0 tx=0x7fce50034000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 shutdown_connections 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fce400652d0 0x7fce40067780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce5803d3e0 0x7fce5804ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce5804d360 0x7fce5803cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 --2- 172.21.15.110:0/394869693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce44003a50 0x7fce580d03d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.321+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 >> 172.21.15.110:0/394869693 conn(0x7fce5800f050 msgr2=0x7fce58055200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.322+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 shutdown_connections 2024-08-17T02:29:16.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.323+0000 7fce4aa00640 1 -- 172.21.15.110:0/394869693 wait complete. 2024-08-17T02:29:16.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.324+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3d2c150430 con 0x7f3d2c0b0610 2024-08-17T02:29:16.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.325+0000 7f3d23e00640 1 -- 172.21.15.110:0/608489748 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d240545b0 con 0x7f3d2c0b0610 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi110.stdout:60129542147 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 msgr2=0x7f3d0c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 0x7f3d0c0676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c14f4c0 tx=0x7f3d18008040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 msgr2=0x7f3d2c163810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009ef0 tx=0x7f3d2400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff0d80054c0 con 0x7ff10006a410 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 shutdown_connections 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3d0c065220 0x7f3d0c0676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d2c15e310 0x7f3d2c14e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d2c15d830 0x7f3d2c14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 --2- 172.21.15.110:0/608489748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d2c0b0610 0x7f3d2c163810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.329+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 >> 172.21.15.110:0/608489748 conn(0x7f3d2c0cb9b0 msgr2=0x7f3d2c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.330+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 shutdown_connections 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.330+0000 7f3d33a00640 1 -- 172.21.15.110:0/608489748 wait complete. 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:16.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.331+0000 7ff0f5600640 1 -- 172.21.15.110:0/1042439699 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff0f0053b00 con 0x7ff10006a410 2024-08-17T02:29:16.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.333+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 msgr2=0x7ff0e0067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.333+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 0x7ff0e0067680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec038000 tx=0x7ff0ec03b000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.333+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 msgr2=0x7ff10013a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.333+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000c880 tx=0x7ff0f0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fadc00054c0 con 0x7fade814c360 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 shutdown_connections 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff0e00651d0 0x7ff0e0067680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff10013e730 0x7ff100156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10013e360 0x7ff1001546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 --2- 172.21.15.110:0/1042439699 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff10006a410 0x7ff10013a4b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 >> 172.21.15.110:0/1042439699 conn(0x7ff1000cc480 msgr2=0x7ff1000abc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7faddf400640 1 -- 172.21.15.110:0/4213294554 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fade00539d0 con 0x7fade814c360 2024-08-17T02:29:16.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 shutdown_connections 2024-08-17T02:29:16.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.334+0000 7ff105000640 1 -- 172.21.15.110:0/1042439699 wait complete. 2024-08-17T02:29:16.336 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:16.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.337+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 msgr2=0x7fadc80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.337+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 0x7fadc80676d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fadd4032000 tx=0x7fadd402f000 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.337+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 msgr2=0x7fade8153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.337+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fade80646a0 tx=0x7fade0009710 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 shutdown_connections 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fadc8065220 0x7fadc80676d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fade814c360 0x7fade8153b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fade814a7e0 0x7fade814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 --2- 172.21.15.110:0/4213294554 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadcc003b60 0x7fade8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.338+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 >> 172.21.15.110:0/4213294554 conn(0x7fade80cb790 msgr2=0x7fade80ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.339+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 shutdown_connections 2024-08-17T02:29:16.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.339+0000 7faded400640 1 -- 172.21.15.110:0/4213294554 wait complete. 2024-08-17T02:29:16.343 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.0 2024-08-17T02:29:16.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.346+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc050067150 con 0x7fc0500c6a30 2024-08-17T02:29:16.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.2 2024-08-17T02:29:16.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.348+0000 7fc046000640 1 -- 172.21.15.110:0/1674825529 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0480517e0 con 0x7fc0500c6a30 2024-08-17T02:29:16.348 INFO:teuthology.orchestra.run.smithi110.stdout:60129542147 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 msgr2=0x7fc02c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 0x7fc02c067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc05015cf40 tx=0x7fc040009040 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 msgr2=0x7fc05015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc048007f60 tx=0x7fc048009860 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 shutdown_connections 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc02c0652a0 0x7fc02c067750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc050159430 0x7fc0500b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc050159060 0x7fc05015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.351+0000 7fc055e00640 1 --2- 172.21.15.110:0/1674825529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0500c6a30 0x7fc05015a530 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:16.352 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.352+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 >> 172.21.15.110:0/1674825529 conn(0x7fc0500cfde0 msgr2=0x7fc0500c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:16.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.352+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 shutdown_connections 2024-08-17T02:29:16.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:16.352+0000 7fc055e00640 1 -- 172.21.15.110:0/1674825529 wait complete. 2024-08-17T02:29:16.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.3 2024-08-17T02:29:16.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.7 2024-08-17T02:29:16.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.5 2024-08-17T02:29:16.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-08-17T02:29:16.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.6 2024-08-17T02:29:17.334 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:29:17.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:29:17.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:29:17.354 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:29:17.356 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:29:17.357 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:29:17.363 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:29:17.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:29:17.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.568+0000 7f737f200640 1 Processor -- start 2024-08-17T02:29:17.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.568+0000 7f737f200640 1 -- start start 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.570+0000 7f737f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73780e5eb0 0x7f73780e6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.570+0000 7f737f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7378033a80 0x7f73780e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.570+0000 7f737f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737804fbe0 con 0x7f7378033f00 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.570+0000 7f737f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7378051210 con 0x7f7378033a80 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.570+0000 7f737f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7378005f50 con 0x7f73780e5eb0 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73780e5eb0 0x7f73780e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f73780e5eb0 0x7f73780e6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56414/0 (socket says 172.21.15.110:56414) 2024-08-17T02:29:17.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 -- 172.21.15.110:0/4075868730 learned_addr learned my addr 172.21.15.110:0/4075868730 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 -- 172.21.15.110:0/4075868730 >> v2:172.21.15.110:3300/0 conn(0x7f7378033a80 msgr2=0x7f73780e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 --2- 172.21.15.110:0/4075868730 >> v2:172.21.15.110:3300/0 conn(0x7f7378033a80 0x7f73780e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 -- 172.21.15.110:0/4075868730 >> v1:172.21.15.110:6789/0 conn(0x7f7378033f00 legacy=0x7f7378052fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.571+0000 7f737de00640 1 -- 172.21.15.110:0/4075868730 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737804fe30 con 0x7f73780e5eb0 2024-08-17T02:29:17.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.572+0000 7f737de00640 1 --2- 172.21.15.110:0/4075868730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780e5eb0 0x7f73780e6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7380065800 tx=0x7f738006f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0dc0535165117c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.573+0000 7f737ca00640 1 -- 172.21.15.110:0/4075868730 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800a65e0 con 0x7f73780e5eb0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.573+0000 7f737ca00640 1 -- 172.21.15.110:0/4075868730 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800a4050 con 0x7f73780e5eb0 2024-08-17T02:29:17.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.573+0000 7f737ca00640 1 -- 172.21.15.110:0/4075868730 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800a65e0 con 0x7f73780e5eb0 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.574+0000 7f737f200640 1 -- 172.21.15.110:0/4075868730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780e5eb0 msgr2=0x7f73780e6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.574+0000 7f737f200640 1 --2- 172.21.15.110:0/4075868730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780e5eb0 0x7f73780e6280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7380065800 tx=0x7f738006f710 comp rx=0 tx=0).stop 2024-08-17T02:29:17.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.575+0000 7f737f200640 1 -- 172.21.15.110:0/4075868730 shutdown_connections 2024-08-17T02:29:17.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.575+0000 7f737f200640 1 --2- 172.21.15.110:0/4075868730 >> v2:172.21.15.110:3300/0 conn(0x7f7378033a80 0x7f73780e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.575+0000 7f737f200640 1 --2- 172.21.15.110:0/4075868730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73780e5eb0 0x7f73780e6280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.575+0000 7f737f200640 1 -- 172.21.15.110:0/4075868730 >> 172.21.15.110:0/4075868730 conn(0x7f7378051600 msgr2=0x7f7378051a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.576+0000 7f737f200640 1 -- 172.21.15.110:0/4075868730 shutdown_connections 2024-08-17T02:29:17.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.576+0000 7f737f200640 1 -- 172.21.15.110:0/4075868730 wait complete. 2024-08-17T02:29:17.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.579+0000 7f737f200640 1 Processor -- start 2024-08-17T02:29:17.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.580+0000 7f737f200640 1 -- start start 2024-08-17T02:29:17.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.582+0000 7f737f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.582+0000 7f737f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 0x7f7378035330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.583+0000 7f737f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73780e5eb0 0x7f7378035870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.583+0000 7f737de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.583+0000 7f737de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56420/0 (socket says 172.21.15.110:56420) 2024-08-17T02:29:17.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.583+0000 7f737d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 0x7f7378035330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.583+0000 7f737d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 0x7f7378035330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51788/0 (socket says 172.21.15.110:51788) 2024-08-17T02:29:17.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.584+0000 7f737de00640 1 -- 172.21.15.110:0/4056697611 learned_addr learned my addr 172.21.15.110:0/4056697611 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.584+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737803a720 con 0x7f73780e5eb0 2024-08-17T02:29:17.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.584+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737803a180 con 0x7f7378033a80 2024-08-17T02:29:17.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.584+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737803a440 con 0x7f7378033f00 2024-08-17T02:29:17.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.585+0000 7f737e800640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73780e5eb0 0x7f7378035870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.586+0000 7f737de00640 1 -- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 msgr2=0x7f7378035330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.586+0000 7f737de00640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 0x7f7378035330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.586+0000 7f737de00640 1 -- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73780e5eb0 msgr2=0x7f7378035870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.586+0000 7f737de00640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73780e5eb0 0x7f7378035870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.586+0000 7f737de00640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738004c200 con 0x7f7378033a80 2024-08-17T02:29:17.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.587+0000 7f737de00640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7380066440 tx=0x7f73800a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.588+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738006fdb0 con 0x7f7378033a80 2024-08-17T02:29:17.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.588+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800a8ab0 con 0x7f7378033a80 2024-08-17T02:29:17.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.588+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800a8e30 con 0x7f7378033a80 2024-08-17T02:29:17.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.588+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7378038470 con 0x7f7378033a80 2024-08-17T02:29:17.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.588+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73780dbfe0 con 0x7f7378033a80 2024-08-17T02:29:17.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.591+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7358005210 con 0x7f7378033a80 2024-08-17T02:29:17.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.594+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7380070260 con 0x7f7378033a80 2024-08-17T02:29:17.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.595+0000 7f7375600640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 0x7f735c067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.596+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7380119d50 con 0x7f7378033a80 2024-08-17T02:29:17.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.597+0000 7f737d400640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 0x7f735c067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.598+0000 7f737d400640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 0x7f735c067780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f737803a930 tx=0x7f7370009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.599+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f73800e7f60 con 0x7f7378033a80 2024-08-17T02:29:17.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.643+0000 7f5b4ca00640 1 Processor -- start 2024-08-17T02:29:17.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.643+0000 7f5b4ca00640 1 -- start start 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.645+0000 7f5b4ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b48159ca0 0x7f5b480ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b47400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b48159ca0 0x7f5b480ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b47400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b48159ca0 0x7f5b480ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49068/0 (socket says 172.21.15.110:49068) 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b47400640 1 -- 172.21.15.110:0/2239562949 learned_addr learned my addr 172.21.15.110:0/2239562949 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 0x7f5b48162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b480cadc0 con 0x7f5b480ca8a0 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480cd6e0 con 0x7f5b48159ca0 2024-08-17T02:29:17.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.646+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480cb060 con 0x7f5b480ccca0 2024-08-17T02:29:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.647+0000 7f5b47e00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 0x7f5b48162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.648+0000 7f5b46000640 1 -- 172.21.15.110:0/2239562949 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3724589290 0 0) 0x7f5b480cadc0 con 0x7f5b480ca8a0 2024-08-17T02:29:17.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.648+0000 7f5b47400640 1 -- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 msgr2=0x7f5b48162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.648+0000 7f5b47400640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 0x7f5b48162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.648+0000 7f5b47400640 1 -- 172.21.15.110:0/2239562949 >> v1:172.21.15.110:6789/0 conn(0x7f5b480ca8a0 legacy=0x7f5b480cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.649+0000 7f5b47400640 1 -- 172.21.15.110:0/2239562949 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b480cb300 con 0x7f5b48159ca0 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.650+0000 7f5b47e00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 0x7f5b48162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.649+0000 7fa477400640 1 Processor -- start 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.649+0000 7fa477400640 1 -- start start 2024-08-17T02:29:17.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.651+0000 7f5b47400640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b48159ca0 0x7f5b480ca360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd820 tx=0x7f5b340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cbef96f490dffa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.651+0000 7f5b46000640 1 -- 172.21.15.110:0/2239562949 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3402ae80 con 0x7f5b48159ca0 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468038ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa477400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680390e0 con 0x7fa4680e6e70 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa477400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa468053520 con 0x7fa468006150 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa477400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680e7950 con 0x7fa468038740 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa474a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa4680e6e70 0x7fa46803a630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41372/0 (socket says 172.21.15.110:41372) 2024-08-17T02:29:17.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7fa474a00640 1 -- 172.21.15.110:0/790277485 learned_addr learned my addr 172.21.15.110:0/790277485 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7f5b46000640 1 -- 172.21.15.110:0/2239562949 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34032440 con 0x7f5b48159ca0 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.652+0000 7f5b46000640 1 -- 172.21.15.110:0/2239562949 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340327c0 con 0x7f5b48159ca0 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b48159ca0 msgr2=0x7f5b480ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b48159ca0 0x7f5b480ca360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd820 tx=0x7f5b340091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 shutdown_connections 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ccca0 0x7f5b48162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422976650 0 0) 0x7fa4680390e0 con 0x7fa4680e6e70 2024-08-17T02:29:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4580034e0 con 0x7fa4680e6e70 2024-08-17T02:29:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/2239562949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b48159ca0 0x7f5b480ca360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.653+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 >> 172.21.15.110:0/2239562949 conn(0x7f5b48098e00 msgr2=0x7f5b4806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 shutdown_connections 2024-08-17T02:29:17.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7f5b4ca00640 1 -- 172.21.15.110:0/2239562949 wait complete. 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420463042 0 0) 0x7fa4580034e0 con 0x7fa4680e6e70 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 msgr2=0x7fa468038ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468038ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 >> v1:172.21.15.177:6789/0 conn(0x7fa468006150 legacy=0x7fa4680e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46803aeb0 con 0x7fa4680e6e70 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fa464001450 con 0x7fa4680e6e70 2024-08-17T02:29:17.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.654+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 >> v1:172.21.15.110:6789/0 conn(0x7fa4680e6e70 legacy=0x7fa46803a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7f85e3e00640 1 Processor -- start 2024-08-17T02:29:17.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7f85e3e00640 1 -- start start 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa458003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa458004170 0x7fa458004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa458004ec0 0x7fa45800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680e7950 con 0x7fa458004ec0 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4580055e0 con 0x7fa458004170 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.655+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800bf10 con 0x7fa468038740 2024-08-17T02:29:17.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa458003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa46fe00640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa458004170 0x7fa458004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa475400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa458004ec0 0x7fa45800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 -- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa458004170 msgr2=0x7fa458004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa458004170 0x7fa458004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 -- 172.21.15.110:0/790277485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa458004ec0 msgr2=0x7fa45800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa458004ec0 0x7fa45800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7fa474a00640 1 -- 172.21.15.110:0/790277485 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45800c190 con 0x7fa468038740 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.656+0000 7f85e3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85e40cd700 0x7f85e40cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e3e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40cf9d0 con 0x7f85e40cc800 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e3e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e40ceb60 con 0x7f85e40cd700 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40cedc0 con 0x7f85e4158c80 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51816/0 (socket says 172.21.15.110:51816) 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 -- 172.21.15.110:0/3120584190 learned_addr learned my addr 172.21.15.110:0/3120584190 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 -- 172.21.15.110:0/3120584190 >> v2:172.21.15.177:3300/0 conn(0x7f85e40cd700 msgr2=0x7f85e40cc2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:29:17.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7fa474a00640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa458003a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa464001de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad163ec46a9f98f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7f5b4ca00640 1 Processor -- start 2024-08-17T02:29:17.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464007220 con 0x7fa468038740 2024-08-17T02:29:17.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464007380 con 0x7fa468038740 2024-08-17T02:29:17.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7fa46f400640 1 -- 172.21.15.110:0/790277485 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464004860 con 0x7fa468038740 2024-08-17T02:29:17.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.658+0000 7f5b4ca00640 1 -- start start 2024-08-17T02:29:17.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 --2- 172.21.15.110:0/3120584190 >> v2:172.21.15.177:3300/0 conn(0x7f85e40cd700 0x7f85e40cc2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 -- 172.21.15.110:0/3120584190 >> v1:172.21.15.110:6789/0 conn(0x7f85e40cc800 legacy=0x7f85e40ca380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.657+0000 7f85e2a00640 1 -- 172.21.15.110:0/3120584190 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40cf0a0 con 0x7f85e4158c80 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7f85e2a00640 1 --2- 172.21.15.110:0/3120584190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009910 tx=0x7f85d40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f516e35e0efaa0b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7fa477400640 1 -- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 msgr2=0x7fa458003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7fa477400640 1 --2- 172.21.15.110:0/790277485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa458003a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa464001de0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7f5b4ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7f85e1600640 1 -- 172.21.15.110:0/3120584190 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d402ad50 con 0x7f85e4158c80 2024-08-17T02:29:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.659+0000 7f85e1600640 1 -- 172.21.15.110:0/3120584190 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4032440 con 0x7f85e4158c80 2024-08-17T02:29:17.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7f85e1600640 1 -- 172.21.15.110:0/3120584190 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4032820 con 0x7f85e4158c80 2024-08-17T02:29:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7fa475400640 1 -- 172.21.15.110:0/790277485 reap_dead start 2024-08-17T02:29:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7fa477400640 1 -- 172.21.15.110:0/790277485 shutdown_connections 2024-08-17T02:29:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7fa477400640 1 -- 172.21.15.110:0/790277485 >> 172.21.15.110:0/790277485 conn(0x7fa46800f070 msgr2=0x7fa468058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7fa477400640 1 -- 172.21.15.110:0/790277485 shutdown_connections 2024-08-17T02:29:17.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7f5b47400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7f85e3e00640 1 -- 172.21.15.110:0/3120584190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 msgr2=0x7f85e40ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7f85e3e00640 1 --2- 172.21.15.110:0/3120584190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f85d4009910 tx=0x7f85d40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f85e3e00640 1 -- 172.21.15.110:0/3120584190 shutdown_connections 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f85e3e00640 1 --2- 172.21.15.110:0/3120584190 >> v2:172.21.15.177:3300/0 conn(0x7f85e40cd700 0x7f85e40cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f85e3e00640 1 --2- 172.21.15.110:0/3120584190 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e4158c80 0x7f85e40ce620 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f85e3e00640 1 -- 172.21.15.110:0/3120584190 >> 172.21.15.110:0/3120584190 conn(0x7f85e4098e30 msgr2=0x7f85e406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f5b4ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b480ccca0 0x7f5b480c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f5b4ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b48159ca0 0x7f5b480c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f5b4ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480c4d90 con 0x7f5b480ccca0 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f5b4ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480b3c50 con 0x7f5b48159ca0 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7f5b4ca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480c4180 con 0x7f5b480ca8a0 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51822/0 (socket says 172.21.15.110:51822) 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 -- 172.21.15.110:0/261073527 learned_addr learned my addr 172.21.15.110:0/261073527 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47e00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b48159ca0 0x7f5b480c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b46a00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b480ccca0 0x7f5b480c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 -- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b48159ca0 msgr2=0x7f5b480c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b48159ca0 0x7f5b480c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 -- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b480ccca0 msgr2=0x7f5b480c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b480ccca0 0x7f5b480c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f5b47400640 1 -- 172.21.15.110:0/261073527 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b34009450 con 0x7f5b480ca8a0 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.660+0000 7fa477400640 1 -- 172.21.15.110:0/790277485 wait complete. 2024-08-17T02:29:17.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7fa477400640 1 Processor -- start 2024-08-17T02:29:17.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f85e3e00640 1 -- 172.21.15.110:0/3120584190 shutdown_connections 2024-08-17T02:29:17.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.663+0000 7fa477400640 1 -- start start 2024-08-17T02:29:17.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7f85e3e00640 1 -- 172.21.15.110:0/3120584190 wait complete. 2024-08-17T02:29:17.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.665+0000 7fa477400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.661+0000 7fa1f9800640 1 Processor -- start 2024-08-17T02:29:17.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.662+0000 7fa1f9800640 1 -- start start 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.665+0000 7f85e3e00640 1 Processor -- start 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.663+0000 7fa1f9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa1f40878a0 0x7fa1f40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.663+0000 7fa1f9800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 0x7fa1f4169a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f9800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f4068d10 con 0x7fa1f4169fc0 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f9800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f40ae2d0 con 0x7fa1f41695e0 2024-08-17T02:29:17.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f9800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f4165f70 con 0x7fa1f40878a0 2024-08-17T02:29:17.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa1f40878a0 0x7fa1f40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 0x7fa1f4169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 0x7fa1f4169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49104/0 (socket says 172.21.15.110:49104) 2024-08-17T02:29:17.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.664+0000 7fa1f3400640 1 -- 172.21.15.110:0/3747507227 learned_addr learned my addr 172.21.15.110:0/3747507227 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.665+0000 7fa477400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 0x7fa46804c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.665+0000 7fa477400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa46804cf20 0x7fa46804d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa474a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa477400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4680df0a0 con 0x7fa4680df8b0 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa477400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa468051cb0 con 0x7fa46804cf20 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa477400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa468051f90 con 0x7fa468038740 2024-08-17T02:29:17.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789953444 0 0) 0x7fa1f4068d10 con 0x7fa1f4169fc0 2024-08-17T02:29:17.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa474a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51838/0 (socket says 172.21.15.110:51838) 2024-08-17T02:29:17.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa46fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 0x7fa46804c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa475400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa46804cf20 0x7fa46804d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1d80034e0 con 0x7fa1f4169fc0 2024-08-17T02:29:17.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa474a00640 1 -- 172.21.15.110:0/2931845608 learned_addr learned my addr 172.21.15.110:0/2931845608 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7f5b47400640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009940 tx=0x7f5b34032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34031920 con 0x7f5b480ca8a0 2024-08-17T02:29:17.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34031a80 con 0x7f5b480ca8a0 2024-08-17T02:29:17.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34031e80 con 0x7f5b480ca8a0 2024-08-17T02:29:17.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3213770479 0 0) 0x7fa1d80034e0 con 0x7fa1f4169fc0 2024-08-17T02:29:17.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 >> v2:172.21.15.177:3300/0 conn(0x7fa1f40878a0 msgr2=0x7fa1f40b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 --2- 172.21.15.110:0/3747507227 >> v2:172.21.15.177:3300/0 conn(0x7fa1f40878a0 0x7fa1f40b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.665+0000 7f85e3e00640 1 -- start start 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa474a00640 1 -- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa46804cf20 msgr2=0x7fa46804d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa474a00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa46804cf20 0x7fa46804d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa474a00640 1 -- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 msgr2=0x7fa46804c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b480c4460 con 0x7f5b480ca8a0 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b480c4a20 con 0x7f5b480ca8a0 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa474a00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 0x7fa46804c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa474a00640 1 -- 172.21.15.110:0/2931845608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468052270 con 0x7fa468038740 2024-08-17T02:29:17.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa46fe00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 0x7fa46804c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:17.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.666+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 msgr2=0x7fa1f4169a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e40cc800 0x7f85e40b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 --2- 172.21.15.110:0/3747507227 >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 0x7fa1f4169a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 0x7f85e4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7f85e3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c4fd0 con 0x7f85e40cd700 2024-08-17T02:29:17.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b48071050 con 0x7f5b480ca8a0 2024-08-17T02:29:17.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7fa474a00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa464034000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c6750 con 0x7f85e4158c80 2024-08-17T02:29:17.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c3f30 con 0x7f85e40cc800 2024-08-17T02:29:17.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f416a400 con 0x7fa1f4169fc0 2024-08-17T02:29:17.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fa1e4001470 con 0x7fa1f4169fc0 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 >> v1:172.21.15.110:6789/0 conn(0x7fa1f4169fc0 legacy=0x7fa1f40acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 0x7fa1d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d8004320 0x7fa1d8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d8004d30 0x7fa1d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4165f70 con 0x7fa1d8004320 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8007c10 con 0x7fa1d8004d30 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.667+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8007dd0 con 0x7fa1d80039d0 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 0x7fa1d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7fa1f3400640 1 --2- 172.21.15.110:0/3747507227 >> v2:172.21.15.110:3300/0 conn(0x7fa1f41695e0 0x7fa1f4169a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:17.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7fa1f3e00640 1 -- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d8004d30 msgr2=0x7fa1d80051d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1d8004d30 0x7fa1d80051d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7fa1f3e00640 1 -- 172.21.15.110:0/3747507227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d8004320 msgr2=0x7fa1d8004780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7fa1f3400640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d8004320 0x7fa1d8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d8004320 0x7fa1d8004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7fa1f3e00640 1 -- 172.21.15.110:0/3747507227 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f416a400 con 0x7fa1d80039d0 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7fa1f8e00640 1 -- 172.21.15.110:0/3747507227 reap_dead start 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7fa1f3400640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d8004320 0x7fa1d8004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464004c90 con 0x7fa468038740 2024-08-17T02:29:17.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464004df0 con 0x7fa468038740 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464007720 con 0x7fa468038740 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56490/0 (socket says 172.21.15.110:56490) 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3400640 1 -- 172.21.15.110:0/2120848315 learned_addr learned my addr 172.21.15.110:0/2120848315 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3400640 1 -- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e40cc800 msgr2=0x7f85e40b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.668+0000 7f85e3400640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e40cc800 0x7f85e40b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e3400640 1 -- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 msgr2=0x7f85e4158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e2000640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 0x7f85e4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e3400640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 0x7f85e4158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e3400640 1 -- 172.21.15.110:0/2120848315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d4009450 con 0x7f85e4158c80 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e2000640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 0x7f85e4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85e3400640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b4f0 tx=0x7f85d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d000f510 con 0x7f85e4158c80 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d000f670 con 0x7f85e4158c80 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.669+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d000fa10 con 0x7f85e4158c80 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40c4210 con 0x7f85e4158c80 2024-08-17T02:29:17.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e40c47d0 con 0x7f85e4158c80 2024-08-17T02:29:17.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.671+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa468052550 con 0x7fa468038740 2024-08-17T02:29:17.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.671+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa468052d50 con 0x7fa468038740 2024-08-17T02:29:17.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.671+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 0x7fa1d8003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0094d0 tx=0x7fa1ec00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fef6cc0dfdce742 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.670+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b34047070 con 0x7f5b480ca8a0 2024-08-17T02:29:17.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.671+0000 7f5b3ea00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 0x7f5b28067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.672+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b340ab260 con 0x7f5b480ca8a0 2024-08-17T02:29:17.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.672+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e40c43a0 con 0x7f85e4158c80 2024-08-17T02:29:17.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.672+0000 7f5b46a00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 0x7f5b28067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.673+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f85d0011400 con 0x7f85e4158c80 2024-08-17T02:29:17.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.674+0000 7f5b46a00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 0x7f5b28067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd540 tx=0x7f5b38007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.674+0000 7f803ee00640 1 Processor -- start 2024-08-17T02:29:17.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.673+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa468052d50 con 0x7fa468038740 2024-08-17T02:29:17.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.674+0000 7f803ee00640 1 -- start start 2024-08-17T02:29:17.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.674+0000 7f85da000640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 0x7f85c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.674+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85d0081730 con 0x7f85e4158c80 2024-08-17T02:29:17.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.675+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec031410 con 0x7fa1d80039d0 2024-08-17T02:29:17.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.675+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec00f040 con 0x7fa1d80039d0 2024-08-17T02:29:17.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.675+0000 7fa1f2a00640 1 -- 172.21.15.110:0/3747507227 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0317a0 con 0x7fa1d80039d0 2024-08-17T02:29:17.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.675+0000 7f85e2a00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 0x7f85c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b340793b0 con 0x7f5b480ca8a0 2024-08-17T02:29:17.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f85e2a00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 0x7f85c4078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85d4034000 tx=0x7f85d4032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.675+0000 7f803ee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80380acdd0 0x7f80380add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f8037e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80380acdd0 0x7f80380add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f8037400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f80380ae6b0 0x7f803806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41378/0 (socket says 172.21.15.110:41378) 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f8037400640 1 -- 172.21.15.110:0/2954576659 learned_addr learned my addr 172.21.15.110:0/2954576659 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80380ad1a0 con 0x7f80380ae6b0 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803815d660 con 0x7f803806dc80 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380b16c0 con 0x7f80380acdd0 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7fa1f9800640 1 -- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 msgr2=0x7fa1d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.676+0000 7fa1f9800640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 0x7fa1d8003de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0094d0 tx=0x7fa1ec00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7f8037e00640 1 -- 172.21.15.110:0/2954576659 >> v1:172.21.15.177:6789/0 conn(0x7f803806dc80 legacy=0x7f80380c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7f8037e00640 1 -- 172.21.15.110:0/2954576659 >> v1:172.21.15.110:6789/0 conn(0x7f80380ae6b0 legacy=0x7f803806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7f8037e00640 1 -- 172.21.15.110:0/2954576659 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380cc190 con 0x7f80380acdd0 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7fa1f9800640 1 -- 172.21.15.110:0/3747507227 shutdown_connections 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7fa1f9800640 1 --2- 172.21.15.110:0/3747507227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1d80039d0 0x7fa1d8003de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7fa1f9800640 1 -- 172.21.15.110:0/3747507227 >> 172.21.15.110:0/3747507227 conn(0x7fa1f40cb790 msgr2=0x7fa1f40cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7f7916400640 1 Processor -- start 2024-08-17T02:29:17.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.677+0000 7f7916400640 1 -- start start 2024-08-17T02:29:17.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.678+0000 7f8037e00640 1 --2- 172.21.15.110:0/2954576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80380add40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8028009850 tx=0x7f80280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baa99afebf7338f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.678+0000 7fa1f9800640 1 -- 172.21.15.110:0/3747507227 shutdown_connections 2024-08-17T02:29:17.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.678+0000 7fa1f9800640 1 -- 172.21.15.110:0/3747507227 wait complete. 2024-08-17T02:29:17.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.678+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f85d004ae40 con 0x7f85e4158c80 2024-08-17T02:29:17.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.678+0000 7f8036a00640 1 -- 172.21.15.110:0/2954576659 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802802ad90 con 0x7f80380acdd0 2024-08-17T02:29:17.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.679+0000 7f8036a00640 1 -- 172.21.15.110:0/2954576659 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028032440 con 0x7f80380acdd0 2024-08-17T02:29:17.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.679+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa46403e600 con 0x7fa468038740 2024-08-17T02:29:17.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.679+0000 7fa45fe00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 0x7fa454067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7fa46fe00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 0x7fa454067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa46402e070 con 0x7fa468038740 2024-08-17T02:29:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4640cde40 con 0x7fa468038740 2024-08-17T02:29:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 msgr2=0x7f80380add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7f803ee00640 1 --2- 172.21.15.110:0/2954576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80380add40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8028009850 tx=0x7f80280090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f1e44e00640 1 Processor -- start 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f7916400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100ada10 0x7f79100b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f7916400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f79100b1120 0x7f79100b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f7916400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100d0ab0 con 0x7f79100b36e0 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f7916400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79100b00c0 con 0x7f79100b1120 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f7916400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79100b0360 con 0x7f79100ada10 2024-08-17T02:29:17.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.683+0000 7fa46fe00640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 0x7fa454067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4680dfc80 tx=0x7fa460007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.680+0000 7fa1f9800640 1 Processor -- start 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7fa1f9800640 1 -- start start 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7fa1f9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 0x7fa1f4178530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7fa1f9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 0x7fa1f4167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.683+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 shutdown_connections 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.683+0000 7f803ee00640 1 --2- 172.21.15.110:0/2954576659 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80380add40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.683+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 >> 172.21.15.110:0/2954576659 conn(0x7f8038067750 msgr2=0x7f80380cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7fa1f3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 0x7fa1f4178530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.682+0000 7f1e44e00640 1 -- start start 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f1e44e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e380e6220 0x7f1e3803a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f1e44e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e38038e10 0x7f1e380066f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7fa1f3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 0x7fa1f4178530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49146/0 (socket says 172.21.15.110:49146) 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7fa1f3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 0x7fa1f4167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7fa1f3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 0x7fa1f4167ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56504/0 (socket says 172.21.15.110:56504) 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7fa1f9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f1e44e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e3803afe0 con 0x7f1e380eac50 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f1e44e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3803b2c0 con 0x7f1e38038e10 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f1e44e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3803b5a0 con 0x7f1e380e6220 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e380e6220 0x7f1e3803a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e380e6220 0x7f1e3803a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56500/0 (socket says 172.21.15.110:56500) 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 -- 172.21.15.110:0/223171310 learned_addr learned my addr 172.21.15.110:0/223171310 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 -- 172.21.15.110:0/223171310 >> v2:172.21.15.110:3300/0 conn(0x7f1e38038e10 msgr2=0x7f1e380066f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 --2- 172.21.15.110:0/223171310 >> v2:172.21.15.110:3300/0 conn(0x7f1e38038e10 0x7f1e380066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 -- 172.21.15.110:0/223171310 >> v1:172.21.15.110:6789/0 conn(0x7f1e380eac50 legacy=0x7f1e38038700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f1e3f400640 1 -- 172.21.15.110:0/223171310 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3803b880 con 0x7f1e380e6220 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.684+0000 7f790ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f79100b1120 0x7f79100b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f79100b1120 0x7f79100b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56498/0 (socket says 172.21.15.110:56498) 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 -- 172.21.15.110:0/3980882284 learned_addr learned my addr 172.21.15.110:0/3980882284 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 -- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100ada10 msgr2=0x7f79100b2c60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 --2- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100ada10 0x7f79100b2c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 -- 172.21.15.110:0/3980882284 >> v1:172.21.15.110:6789/0 conn(0x7f79100b36e0 legacy=0x7f79100adde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:29:17.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.685+0000 7f790ea00640 1 -- 172.21.15.110:0/3980882284 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100b0640 con 0x7f79100b1120 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 shutdown_connections 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7fa1f8e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7fa1f8e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51878/0 (socket says 172.21.15.110:51878) 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7fa1f3e00640 1 -- 172.21.15.110:0/2950410571 learned_addr learned my addr 172.21.15.110:0/2950410571 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41681e0 con 0x7fa1d80039d0 2024-08-17T02:29:17.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40a5600 con 0x7fa1f4167850 2024-08-17T02:29:17.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.687+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f40a58a0 con 0x7fa1f40a92d0 2024-08-17T02:29:17.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.686+0000 7f803ee00640 1 -- 172.21.15.110:0/2954576659 wait complete. 2024-08-17T02:29:17.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.687+0000 7f790ea00640 1 --2- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100b1120 0x7f79100b31a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009910 tx=0x7f78fc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1736697f8e1576 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.687+0000 7f1e3f400640 1 --2- 172.21.15.110:0/223171310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380e6220 0x7f1e3803a6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e38058e50 tx=0x7f1e340091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d092703139e7e23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.687+0000 7f1e3e000640 1 -- 172.21.15.110:0/223171310 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3402ae00 con 0x7f1e380e6220 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 -- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 msgr2=0x7fa1f4167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 0x7fa1f4167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 -- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 msgr2=0x7fa1f4178530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 0x7fa1f4178530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f40a5b80 con 0x7fa1f40a92d0 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f790e000640 1 -- 172.21.15.110:0/3980882284 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036640 con 0x7f79100b1120 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f790e000640 1 -- 172.21.15.110:0/3980882284 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc0367a0 con 0x7f79100b1120 2024-08-17T02:29:17.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f790e000640 1 -- 172.21.15.110:0/3980882284 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc036b80 con 0x7f79100b1120 2024-08-17T02:29:17.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.687+0000 7f1e3e000640 1 -- 172.21.15.110:0/223171310 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34032440 con 0x7f1e380e6220 2024-08-17T02:29:17.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f1e3e000640 1 -- 172.21.15.110:0/223171310 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34032820 con 0x7f1e380e6220 2024-08-17T02:29:17.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f803ee00640 1 Processor -- start 2024-08-17T02:29:17.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f803ee00640 1 -- start start 2024-08-17T02:29:17.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.690+0000 7f7916400640 1 -- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100b1120 msgr2=0x7f79100b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.690+0000 7f7916400640 1 --2- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100b1120 0x7f79100b31a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78fc009910 tx=0x7f78fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f1e44e00640 1 -- 172.21.15.110:0/223171310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380e6220 msgr2=0x7f1e3803a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7f1e44e00640 1 --2- 172.21.15.110:0/223171310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380e6220 0x7f1e3803a6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1e38058e50 tx=0x7f1e340091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f1e44e00640 1 -- 172.21.15.110:0/223171310 shutdown_connections 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f1e44e00640 1 --2- 172.21.15.110:0/223171310 >> v2:172.21.15.110:3300/0 conn(0x7f1e38038e10 0x7f1e380066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f1e44e00640 1 --2- 172.21.15.110:0/223171310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380e6220 0x7f1e3803a6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7f1e44e00640 1 -- 172.21.15.110:0/223171310 >> 172.21.15.110:0/223171310 conn(0x7f1e3800f050 msgr2=0x7f1e38058f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1f8e00640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1f41699b0 tx=0x7fa1e4000d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4007430 con 0x7fa1f40a92d0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400ca10 con 0x7fa1f40a92d0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.688+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400cdd0 con 0x7fa1f40a92d0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f40a5e60 con 0x7fa1f40a92d0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.689+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f4178a70 con 0x7fa1f40a92d0 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 -- 172.21.15.110:0/3980882284 shutdown_connections 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 --2- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100b1120 0x7f79100b31a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 --2- 172.21.15.110:0/3980882284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100ada10 0x7f79100b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 -- 172.21.15.110:0/3980882284 >> 172.21.15.110:0/3980882284 conn(0x7f79100cfdf0 msgr2=0x7f79100d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 -- 172.21.15.110:0/3980882284 shutdown_connections 2024-08-17T02:29:17.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7f7916400640 1 -- 172.21.15.110:0/3980882284 wait complete. 2024-08-17T02:29:17.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.692+0000 7f803ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 0x7f803814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.692+0000 7f1e44e00640 1 -- 172.21.15.110:0/223171310 shutdown_connections 2024-08-17T02:29:17.709 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.691+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa1e4004810 con 0x7fa1f40a92d0 2024-08-17T02:29:17.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.692+0000 7f803ee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80381708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.692+0000 7f803ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 0x7f80380ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7fa1eb400640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 0x7fa1d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f803ee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c54e0 con 0x7f80380acdd0 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f8037e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 0x7f803814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f8037e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 0x7f803814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:56506/0 (socket says 172.21.15.110:56506) 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f8037e00640 1 -- 172.21.15.110:0/706043751 learned_addr learned my addr 172.21.15.110:0/706043751 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f803ce00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 0x7f80380ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f803ee00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380c5a60 con 0x7f803806dc80 2024-08-17T02:29:17.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f803ee00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803814c240 con 0x7f80380ae6b0 2024-08-17T02:29:17.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f40a59e0 con 0x7fa1f40a92d0 2024-08-17T02:29:17.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1e40813e0 con 0x7fa1f40a92d0 2024-08-17T02:29:17.712 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f7916400640 1 Processor -- start 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f8037400640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80381708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 -- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 msgr2=0x7f803814bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 0x7f803814bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 -- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 msgr2=0x7f80381708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80381708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028009390 con 0x7f80380ae6b0 2024-08-17T02:29:17.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 0x7fa1d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.694+0000 7f803ce00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 0x7f80380ca660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f803000c790 tx=0x7f8030001590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.693+0000 7f1e44e00640 1 -- 172.21.15.110:0/223171310 wait complete. 2024-08-17T02:29:17.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.695+0000 7f1e44e00640 1 Processor -- start 2024-08-17T02:29:17.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.696+0000 7fa1f3e00640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 0x7fa1d4067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b080 tx=0x7fa1ec036000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.696+0000 7f1e44e00640 1 -- start start 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.695+0000 7f7916400640 1 -- start start 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100ada10 0x7f791014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79100b36e0 0x7f79100ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791015b0e0 con 0x7f79100b36e0 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791015a390 con 0x7f79100ada10 2024-08-17T02:29:17.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f7916400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791015a7b0 con 0x7f79100b1120 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f790ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f790f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100ada10 0x7f791014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f790ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51898/0 (socket says 172.21.15.110:51898) 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.697+0000 7f790ea00640 1 -- 172.21.15.110:0/3819637916 learned_addr learned my addr 172.21.15.110:0/3819637916 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790fe00640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79100b36e0 0x7f79100ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f1e44e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 0x7f1e3800ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 -- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100ada10 msgr2=0x7f791014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100ada10 0x7f791014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 -- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79100b36e0 msgr2=0x7f79100ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79100b36e0 0x7f79100ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 -- 172.21.15.110:0/3819637916 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc009450 con 0x7f79100b1120 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f1e44e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.698+0000 7f790ea00640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78fc036fd0 tx=0x7f78fc03e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e44e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380eac50 0x7f1e38057fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc000d10 con 0x7f79100b1120 2024-08-17T02:29:17.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc03ee40 con 0x7f79100b1120 2024-08-17T02:29:17.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc0146c0 con 0x7f79100b1120 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e44e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3800d830 con 0x7f1e38038e10 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e44e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3800cc20 con 0x7f1e380eac50 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e3ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:51902/0 (socket says 172.21.15.110:51902) 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e3ea00640 1 -- 172.21.15.110:0/2235926520 learned_addr learned my addr 172.21.15.110:0/2235926520 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e44e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3800cf00 con 0x7f1e380e6220 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f1e3f400640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 0x7f1e3800ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791015aa90 con 0x7f79100b1120 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.699+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791015b570 con 0x7f79100b1120 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.700+0000 7f1e3ea00640 1 -- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380eac50 msgr2=0x7f1e38057fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.700+0000 7f1e3ea00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380eac50 0x7f1e38057fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.700+0000 7f1e3ea00640 1 -- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 msgr2=0x7f1e3800ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.701+0000 7f1e3ea00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 0x7f1e3800ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.701+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7910064db0 con 0x7f79100b1120 2024-08-17T02:29:17.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.701+0000 7f1e3ea00640 1 -- 172.21.15.110:0/2235926520 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e34009450 con 0x7f1e380e6220 2024-08-17T02:29:17.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.701+0000 7f1e3f400640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 0x7f1e3800ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:17.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.700+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa1f40a59e0 con 0x7fa1f40a92d0 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e3ea00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b5e0 tx=0x7f1e2c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f78fc012440 con 0x7f79100b1120 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.703+0000 7f7906a00640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 0x7f78f0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.703+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000a5e0 con 0x7f80380ae6b0 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.703+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000a760 con 0x7f80380ae6b0 2024-08-17T02:29:17.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.703+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000ab20 con 0x7f80380ae6b0 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00f590 con 0x7f1e380e6220 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2c00f710 con 0x7f1e380e6220 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c00fad0 con 0x7f1e380e6220 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3800d1e0 con 0x7f1e380e6220 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.702+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e380e54b0 con 0x7f1e380e6220 2024-08-17T02:29:17.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.703+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f78fc0a4120 con 0x7f79100b1120 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.704+0000 7f803ee00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80381711c0 con 0x7f80380ae6b0 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.704+0000 7f803ee00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380c56f0 con 0x7f80380ae6b0 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.704+0000 7f790f400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 0x7f78f0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.705+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c005210 con 0x7f1e380e6220 2024-08-17T02:29:17.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.705+0000 7f790f400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 0x7f78f0067630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7900009950 tx=0x7f7900008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.705+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c005210 con 0x7f80380ae6b0 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.707+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f78fc0721e0 con 0x7f79100b1120 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.710+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1e2c01a460 con 0x7f1e380e6220 2024-08-17T02:29:17.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.710+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8030003030 con 0x7f80380ae6b0 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.711+0000 7f1e32a00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 0x7f1e20067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.711+0000 7f802f400640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 0x7f80180676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:17.726 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.712+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e2c082b50 con 0x7f1e380e6220 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.713+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1e2c050de0 con 0x7f1e380e6220 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.714+0000 7f1e3f400640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 0x7f1e20067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.714+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8030082b20 con 0x7f80380ae6b0 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.715+0000 7f8037e00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 0x7f80180676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.717+0000 7f8037e00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 0x7f80180676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8028009130 tx=0x7f8028032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.717+0000 7f1e3f400640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 0x7f1e20067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e34034000 tx=0x7f1e34032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.718+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8030050d00 con 0x7f80380ae6b0 2024-08-17T02:29:17.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.979+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73580054c0 con 0x7f7378033a80 2024-08-17T02:29:17.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.980+0000 7f7375600640 1 -- 172.21.15.110:0/4056697611 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73800e7f60 con 0x7f7378033a80 2024-08-17T02:29:17.981 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:17.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.985+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 msgr2=0x7f735c067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.985+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 0x7f735c067780 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f737803a930 tx=0x7f7370009060 comp rx=0 tx=0).stop 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.985+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 msgr2=0x7f7378034df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:17.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7380066440 tx=0x7f73800a9000 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 shutdown_connections 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f735c0652d0 0x7f735c067780 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73780e5eb0 0x7f7378035870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7378033f00 0x7f7378035330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.986+0000 7f737f200640 1 --2- 172.21.15.110:0/4056697611 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7378033a80 0x7f7378034df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.987+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 >> 172.21.15.110:0/4056697611 conn(0x7f7378051600 msgr2=0x7f73780dee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.987+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 shutdown_connections 2024-08-17T02:29:17.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:17.987+0000 7f737f200640 1 -- 172.21.15.110:0/4056697611 wait complete. 2024-08-17T02:29:18.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-08-17T02:29:18.013 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.054+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1e1c005790 con 0x7f1e380e6220 2024-08-17T02:29:18.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.055+0000 7f1e32a00640 1 -- 172.21.15.110:0/2235926520 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e2c050de0 con 0x7f1e380e6220 2024-08-17T02:29:18.055 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:18.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.057+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 msgr2=0x7f1e20067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.057+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 0x7f1e20067750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1e34034000 tx=0x7f1e34032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.057+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 msgr2=0x7f1e38057a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.057+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b5e0 tx=0x7f1e2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 shutdown_connections 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1e200652a0 0x7f1e20067750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e380eac50 0x7f1e38057fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e380e6220 0x7f1e38057a70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 --2- 172.21.15.110:0/2235926520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e38038e10 0x7f1e3800ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 >> 172.21.15.110:0/2235926520 conn(0x7f1e3800f050 msgr2=0x7f1e380e7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 shutdown_connections 2024-08-17T02:29:18.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.058+0000 7f1e44e00640 1 -- 172.21.15.110:0/2235926520 wait complete. 2024-08-17T02:29:18.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.6 2024-08-17T02:29:18.074 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.089+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa468052d50 con 0x7fa468038740 2024-08-17T02:29:18.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.090+0000 7fa45fe00640 1 -- 172.21.15.110:0/2931845608 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa464070cf0 con 0x7fa468038740 2024-08-17T02:29:18.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.090+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5b48156d50 con 0x7f5b480ca8a0 2024-08-17T02:29:18.091 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:18.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.090+0000 7f5b3ea00640 1 -- 172.21.15.110:0/261073527 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b34037030 con 0x7f5b480ca8a0 2024-08-17T02:29:18.091 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:18.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.093+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85e4071050 con 0x7f85e4158c80 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.093+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 msgr2=0x7fa454067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.093+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 0x7fa454067750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4680dfc80 tx=0x7fa460007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.093+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 msgr2=0x7fa468051360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.093+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa464034000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 shutdown_connections 2024-08-17T02:29:18.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa4540652a0 0x7fa454067750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa46804cf20 0x7fa46804d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4680df8b0 0x7fa46804c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 --2- 172.21.15.110:0/2931845608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa468038740 0x7fa468051360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 >> 172.21.15.110:0/2931845608 conn(0x7fa46800f070 msgr2=0x7fa468006cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 msgr2=0x7f5b28067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 0x7f5b28067750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd540 tx=0x7f5b38007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 msgr2=0x7f5b48155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009940 tx=0x7f5b34032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 shutdown_connections 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f85da000640 1 -- 172.21.15.110:0/2120848315 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85d004f900 con 0x7f85e4158c80 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7fa477400640 1 -- 172.21.15.110:0/2931845608 wait complete. 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 shutdown_connections 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5b280652a0 0x7f5b28067750 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cd540 tx=0x7f5b38007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:18.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b48159ca0 0x7f5b480c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b480ccca0 0x7f5b480c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 --2- 172.21.15.110:0/261073527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b480ca8a0 0x7f5b48155440 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.094+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 >> 172.21.15.110:0/261073527 conn(0x7f5b48098e00 msgr2=0x7f5b4815cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.097 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:18.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.095+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 shutdown_connections 2024-08-17T02:29:18.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.095+0000 7f5b4ca00640 1 -- 172.21.15.110:0/261073527 wait complete. 2024-08-17T02:29:18.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.096+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 msgr2=0x7f85c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.096+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 0x7f85c4078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85d4034000 tx=0x7f85d4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.096+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 msgr2=0x7f85e40b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.096+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b4f0 tx=0x7f85d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 shutdown_connections 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f85c40762e0 0x7f85c4078790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e4158c80 0x7f85e40b1300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85e40cd700 0x7f85e4158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 --2- 172.21.15.110:0/2120848315 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e40cc800 0x7f85e40b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 >> 172.21.15.110:0/2120848315 conn(0x7f85e4098e30 msgr2=0x7f85e40ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 shutdown_connections 2024-08-17T02:29:18.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.097+0000 7f85e3e00640 1 -- 172.21.15.110:0/2120848315 wait complete. 2024-08-17T02:29:18.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.106+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa1f40a59e0 con 0x7fa1f40a92d0 2024-08-17T02:29:18.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.109+0000 7fa1eb400640 1 -- 172.21.15.110:0/2950410571 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1f40a59e0 con 0x7fa1f40a92d0 2024-08-17T02:29:18.110 INFO:teuthology.orchestra.run.smithi110.stdout:60129542148 2024-08-17T02:29:18.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.112+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 msgr2=0x7fa1d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.112+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 0x7fa1d4067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b080 tx=0x7fa1ec036000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.112+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 msgr2=0x7fa1f40a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.112+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1f41699b0 tx=0x7fa1e4000d50 comp rx=0 tx=0).stop 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 shutdown_connections 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa1d4065150 0x7fa1d4067600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1f40a92d0 0x7fa1f40a9740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1f4167850 0x7fa1f4167ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 --2- 172.21.15.110:0/2950410571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80039d0 0x7fa1f4178530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 >> 172.21.15.110:0/2950410571 conn(0x7fa1f40cb790 msgr2=0x7fa1f4069df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 shutdown_connections 2024-08-17T02:29:18.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.113+0000 7fa1f9800640 1 -- 172.21.15.110:0/2950410571 wait complete. 2024-08-17T02:29:18.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.0 2024-08-17T02:29:18.118 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2024-08-17T02:29:18.121 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-08-17T02:29:18.121 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.129+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7910152fb0 con 0x7f79100b1120 2024-08-17T02:29:18.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-08-17T02:29:18.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.130+0000 7f7906a00640 1 -- 172.21.15.110:0/3819637916 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78fc075800 con 0x7f79100b1120 2024-08-17T02:29:18.131 INFO:teuthology.orchestra.run.smithi110.stdout:60129542149 2024-08-17T02:29:18.131 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f800c005790 con 0x7f80380ae6b0 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 msgr2=0x7f78f0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 0x7f78f0067630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7900009950 tx=0x7f7900008040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 msgr2=0x7f79100ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f78fc036fd0 tx=0x7f78fc03e000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 shutdown_connections 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f78f0065180 0x7f78f0067630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79100b36e0 0x7f79100ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79100b1120 0x7f79100ae150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 --2- 172.21.15.110:0/3819637916 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79100ada10 0x7f791014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 >> 172.21.15.110:0/3819637916 conn(0x7f79100cfdf0 msgr2=0x7f7910068190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 shutdown_connections 2024-08-17T02:29:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f802f400640 1 -- 172.21.15.110:0/706043751 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8030054320 con 0x7f80380ae6b0 2024-08-17T02:29:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.133+0000 7f7916400640 1 -- 172.21.15.110:0/3819637916 wait complete. 2024-08-17T02:29:18.135 INFO:teuthology.orchestra.run.smithi110.stdout:60129542150 2024-08-17T02:29:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.135+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 msgr2=0x7f80180676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.135+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 0x7f80180676d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8028009130 tx=0x7f8028032000 comp rx=0 tx=0).stop 2024-08-17T02:29:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.135+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 msgr2=0x7f80380ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.135+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 0x7f80380ca660 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f803000c790 tx=0x7f8030001590 comp rx=0 tx=0).stop 2024-08-17T02:29:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 shutdown_connections 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8018065220 0x7f80180676d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80380ae6b0 0x7f80380ca660 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80380acdd0 0x7f80381708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 --2- 172.21.15.110:0/706043751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f803806dc80 0x7f803814bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 >> 172.21.15.110:0/706043751 conn(0x7f8038067750 msgr2=0x7f80380c9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 shutdown_connections 2024-08-17T02:29:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.136+0000 7f802cc00640 1 -- 172.21.15.110:0/706043751 wait complete. 2024-08-17T02:29:18.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-08-17T02:29:18.153 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-08-17T02:29:18.153 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:18.153 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:29:18.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:18.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.339+0000 7f38de400640 1 Processor -- start 2024-08-17T02:29:18.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.339+0000 7f38de400640 1 -- start start 2024-08-17T02:29:18.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 0x7f38d80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 0x7f38d80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38d80ccad0 0x7f38d80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80cd6e0 con 0x7f38d80ccad0 2024-08-17T02:29:18.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d80ccf70 con 0x7f38d8159ca0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38de400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80cadc0 con 0x7f38d80ca8a0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38dda00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38d80ccad0 0x7f38d80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38dda00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38d80ccad0 0x7f38d80cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49184/0 (socket says 172.21.15.110:49184) 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.340+0000 7f38dda00640 1 -- 172.21.15.110:0/3053057643 learned_addr learned my addr 172.21.15.110:0/3053057643 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38d7e00640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 0x7f38d80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dd000640 1 --2- 172.21.15.110:0/3053057643 >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 0x7f38d80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dda00640 1 -- 172.21.15.110:0/3053057643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 msgr2=0x7f38d80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dda00640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 0x7f38d80cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dda00640 1 -- 172.21.15.110:0/3053057643 >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 msgr2=0x7f38d80ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dda00640 1 --2- 172.21.15.110:0/3053057643 >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 0x7f38d80ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dda00640 1 -- 172.21.15.110:0/3053057643 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80cb060 con 0x7f38d80ccad0 2024-08-17T02:29:18.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38d7e00640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 0x7f38d80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.341+0000 7f38dd000640 1 --2- 172.21.15.110:0/3053057643 >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 0x7f38d80ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38dda00640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ccad0 0x7f38d80cdb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38d808a320 tx=0x7f38d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634cf3ac94f16377 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38d7400640 1 -- 172.21.15.110:0/3053057643 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d0031400 con 0x7f38d80ccad0 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38d7400640 1 -- 172.21.15.110:0/3053057643 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d002d050 con 0x7f38d80ccad0 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38d7400640 1 -- 172.21.15.110:0/3053057643 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00317d0 con 0x7f38d80ccad0 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38de400640 1 -- 172.21.15.110:0/3053057643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ccad0 msgr2=0x7f38d80cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.342+0000 7f38de400640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ccad0 0x7f38d80cdb30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f38d808a320 tx=0x7f38d0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 -- 172.21.15.110:0/3053057643 shutdown_connections 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ccad0 0x7f38d80cdb30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 --2- 172.21.15.110:0/3053057643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ca8a0 0x7f38d80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 --2- 172.21.15.110:0/3053057643 >> v2:172.21.15.177:3300/0 conn(0x7f38d8159ca0 0x7f38d80ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 -- 172.21.15.110:0/3053057643 >> 172.21.15.110:0/3053057643 conn(0x7f38d8098e00 msgr2=0x7f38d806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 -- 172.21.15.110:0/3053057643 shutdown_connections 2024-08-17T02:29:18.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.343+0000 7f38de400640 1 -- 172.21.15.110:0/3053057643 wait complete. 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.344+0000 7f38de400640 1 Processor -- start 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.344+0000 7f38de400640 1 -- start start 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ccad0 0x7f38d809d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d8159ca0 0x7f38d80c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c40e0 con 0x7f38d80ca8a0 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c8ae0 con 0x7f38d8159ca0 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38de400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d80c8d80 con 0x7f38d80ccad0 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38dd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38dd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49192/0 (socket says 172.21.15.110:49192) 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38dd000640 1 -- 172.21.15.110:0/3085964003 learned_addr learned my addr 172.21.15.110:0/3085964003 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38dda00640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d8159ca0 0x7f38d80c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.345+0000 7f38d7e00640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ccad0 0x7f38d809d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 -- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ccad0 msgr2=0x7f38d809d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ccad0 0x7f38d809d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 -- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d8159ca0 msgr2=0x7f38d80c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d8159ca0 0x7f38d80c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 -- 172.21.15.110:0/3085964003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0009ae0 con 0x7f38d80ca8a0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38dd000640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c880 tx=0x7f38cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00ce10 con 0x7f38d80ca8a0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc007830 con 0x7f38d80ca8a0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d80c9060 con 0x7f38d80ca8a0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc007c10 con 0x7f38d80ca8a0 2024-08-17T02:29:18.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.346+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d809d5e0 con 0x7f38d80ca8a0 2024-08-17T02:29:18.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.347+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d8157450 con 0x7f38d80ca8a0 2024-08-17T02:29:18.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.348+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38cc011600 con 0x7f38d80ca8a0 2024-08-17T02:29:18.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.349+0000 7f38cbe00640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 0x7f38b8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.349+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38cc082370 con 0x7f38d80ca8a0 2024-08-17T02:29:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.349+0000 7f38d7e00640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 0x7f38b8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.350+0000 7f38d7e00640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 0x7f38b8067630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38d8067980 tx=0x7f38c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.353 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.353+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38d8157450 con 0x7f38d80ca8a0 2024-08-17T02:29:18.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.527+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38d80c3dc0 con 0x7f38b8065180 2024-08-17T02:29:18.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.533+0000 7f38cbe00640 1 -- 172.21.15.110:0/3085964003 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264536 (secure 0 0 0) 0x7f38d80c3dc0 con 0x7f38b8065180 2024-08-17T02:29:18.537 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:18.538 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 msgr2=0x7f38b8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 0x7f38b8067630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38d8067980 tx=0x7f38c4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 msgr2=0x7f38d80c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c880 tx=0x7f38cc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 shutdown_connections 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38b8065180 0x7f38b8067630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d8159ca0 0x7f38d80c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38d80ccad0 0x7f38d809d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 --2- 172.21.15.110:0/3085964003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d80ca8a0 0x7f38d80c85a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 >> 172.21.15.110:0/3085964003 conn(0x7f38d8098e00 msgr2=0x7f38d8068460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 shutdown_connections 2024-08-17T02:29:18.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.537+0000 7f38de400640 1 -- 172.21.15.110:0/3085964003 wait complete. 2024-08-17T02:29:18.554 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:29:17.438245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398492,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576228,"statfs":{"total":773094113280,"available":770638057472,"internally_reserved":0,"allocated":3055616,"data_stored":1814180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002128"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503311+0000","last_change":"2024-08-17T02:29:09.500528+0000","last_active":"2024-08-17T02:29:09.503311+0000","last_peered":"2024-08-17T02:29:09.503311+0000","last_clean":"2024-08-17T02:29:09.503311+0000","last_became_active":"2024-08-17T02:29:09.500277+0000","last_became_peered":"2024-08-17T02:29:09.500277+0000","last_unstale":"2024-08-17T02:29:09.503311+0000","last_undegraded":"2024-08-17T02:29:09.503311+0000","last_fullsized":"2024-08-17T02:29:09.503311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494232+0000","last_change":"2024-08-17T02:29:09.488194+0000","last_active":"2024-08-17T02:29:09.494232+0000","last_peered":"2024-08-17T02:29:09.494232+0000","last_clean":"2024-08-17T02:29:09.494232+0000","last_became_active":"2024-08-17T02:29:09.487890+0000","last_became_peered":"2024-08-17T02:29:09.487890+0000","last_unstale":"2024-08-17T02:29:09.494232+0000","last_undegraded":"2024-08-17T02:29:09.494232+0000","last_fullsized":"2024-08-17T02:29:09.494232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.476701+0000","last_change":"2024-08-17T02:29:09.474732+0000","last_active":"2024-08-17T02:29:09.476701+0000","last_peered":"2024-08-17T02:29:09.476701+0000","last_clean":"2024-08-17T02:29:09.476701+0000","last_became_active":"2024-08-17T02:29:09.473873+0000","last_became_peered":"2024-08-17T02:29:09.473873+0000","last_unstale":"2024-08-17T02:29:09.476701+0000","last_undegraded":"2024-08-17T02:29:09.476701+0000","last_fullsized":"2024-08-17T02:29:09.476701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:05.177148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501146+0000","last_change":"2024-08-17T02:29:09.497768+0000","last_active":"2024-08-17T02:29:09.501146+0000","last_peered":"2024-08-17T02:29:09.501146+0000","last_clean":"2024-08-17T02:29:09.501146+0000","last_became_active":"2024-08-17T02:29:09.497468+0000","last_became_peered":"2024-08-17T02:29:09.497468+0000","last_unstale":"2024-08-17T02:29:09.501146+0000","last_undegraded":"2024-08-17T02:29:09.501146+0000","last_fullsized":"2024-08-17T02:29:09.501146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.505816+0000","last_change":"2024-08-17T02:29:09.503605+0000","last_active":"2024-08-17T02:29:09.505816+0000","last_peered":"2024-08-17T02:29:09.505816+0000","last_clean":"2024-08-17T02:29:09.505816+0000","last_became_active":"2024-08-17T02:29:09.503452+0000","last_became_peered":"2024-08-17T02:29:09.503452+0000","last_unstale":"2024-08-17T02:29:09.505816+0000","last_undegraded":"2024-08-17T02:29:09.505816+0000","last_fullsized":"2024-08-17T02:29:09.505816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501345+0000","last_change":"2024-08-17T02:29:09.498723+0000","last_active":"2024-08-17T02:29:09.501345+0000","last_peered":"2024-08-17T02:29:09.501345+0000","last_clean":"2024-08-17T02:29:09.501345+0000","last_became_active":"2024-08-17T02:29:09.498313+0000","last_became_peered":"2024-08-17T02:29:09.498313+0000","last_unstale":"2024-08-17T02:29:09.501345+0000","last_undegraded":"2024-08-17T02:29:09.501345+0000","last_fullsized":"2024-08-17T02:29:09.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502472+0000","last_change":"2024-08-17T02:29:09.494498+0000","last_active":"2024-08-17T02:29:09.502472+0000","last_peered":"2024-08-17T02:29:09.502472+0000","last_clean":"2024-08-17T02:29:09.502472+0000","last_became_active":"2024-08-17T02:29:09.494218+0000","last_became_peered":"2024-08-17T02:29:09.494218+0000","last_unstale":"2024-08-17T02:29:09.502472+0000","last_undegraded":"2024-08-17T02:29:09.502472+0000","last_fullsized":"2024-08-17T02:29:09.502472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492697+0000","last_change":"2024-08-17T02:29:09.491080+0000","last_active":"2024-08-17T02:29:09.492697+0000","last_peered":"2024-08-17T02:29:09.492697+0000","last_clean":"2024-08-17T02:29:09.492697+0000","last_became_active":"2024-08-17T02:29:09.490793+0000","last_became_peered":"2024-08-17T02:29:09.490793+0000","last_unstale":"2024-08-17T02:29:09.492697+0000","last_undegraded":"2024-08-17T02:29:09.492697+0000","last_fullsized":"2024-08-17T02:29:09.492697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503294+0000","last_change":"2024-08-17T02:29:09.498187+0000","last_active":"2024-08-17T02:29:09.503294+0000","last_peered":"2024-08-17T02:29:09.503294+0000","last_clean":"2024-08-17T02:29:09.503294+0000","last_became_active":"2024-08-17T02:29:09.491354+0000","last_became_peered":"2024-08-17T02:29:09.491354+0000","last_unstale":"2024-08-17T02:29:09.503294+0000","last_undegraded":"2024-08-17T02:29:09.503294+0000","last_fullsized":"2024-08-17T02:29:09.503294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:21.754886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494177+0000","last_change":"2024-08-17T02:29:09.484467+0000","last_active":"2024-08-17T02:29:09.494177+0000","last_peered":"2024-08-17T02:29:09.494177+0000","last_clean":"2024-08-17T02:29:09.494177+0000","last_became_active":"2024-08-17T02:29:09.483924+0000","last_became_peered":"2024-08-17T02:29:09.483924+0000","last_unstale":"2024-08-17T02:29:09.494177+0000","last_undegraded":"2024-08-17T02:29:09.494177+0000","last_fullsized":"2024-08-17T02:29:09.494177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.490799+0000","last_change":"2024-08-17T02:29:09.483777+0000","last_active":"2024-08-17T02:29:09.490799+0000","last_peered":"2024-08-17T02:29:09.490799+0000","last_clean":"2024-08-17T02:29:09.490799+0000","last_became_active":"2024-08-17T02:29:09.483532+0000","last_became_peered":"2024-08-17T02:29:09.483532+0000","last_unstale":"2024-08-17T02:29:09.490799+0000","last_undegraded":"2024-08-17T02:29:09.490799+0000","last_fullsized":"2024-08-17T02:29:09.490799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484875+0000","last_change":"2024-08-17T02:29:09.482400+0000","last_active":"2024-08-17T02:29:09.484875+0000","last_peered":"2024-08-17T02:29:09.484875+0000","last_clean":"2024-08-17T02:29:09.484875+0000","last_became_active":"2024-08-17T02:29:09.482163+0000","last_became_peered":"2024-08-17T02:29:09.482163+0000","last_unstale":"2024-08-17T02:29:09.484875+0000","last_undegraded":"2024-08-17T02:29:09.484875+0000","last_fullsized":"2024-08-17T02:29:09.484875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:22.158713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483651+0000","last_change":"2024-08-17T02:29:09.481502+0000","last_active":"2024-08-17T02:29:09.483651+0000","last_peered":"2024-08-17T02:29:09.483651+0000","last_clean":"2024-08-17T02:29:09.483651+0000","last_became_active":"2024-08-17T02:29:09.481144+0000","last_became_peered":"2024-08-17T02:29:09.481144+0000","last_unstale":"2024-08-17T02:29:09.483651+0000","last_undegraded":"2024-08-17T02:29:09.483651+0000","last_fullsized":"2024-08-17T02:29:09.483651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494273+0000","last_change":"2024-08-17T02:29:09.485218+0000","last_active":"2024-08-17T02:29:09.494273+0000","last_peered":"2024-08-17T02:29:09.494273+0000","last_clean":"2024-08-17T02:29:09.494273+0000","last_became_active":"2024-08-17T02:29:09.484159+0000","last_became_peered":"2024-08-17T02:29:09.484159+0000","last_unstale":"2024-08-17T02:29:09.494273+0000","last_undegraded":"2024-08-17T02:29:09.494273+0000","last_fullsized":"2024-08-17T02:29:09.494273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:52.833765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.485281+0000","last_change":"2024-08-17T02:29:09.483147+0000","last_active":"2024-08-17T02:29:09.485281+0000","last_peered":"2024-08-17T02:29:09.485281+0000","last_clean":"2024-08-17T02:29:09.485281+0000","last_became_active":"2024-08-17T02:29:09.482881+0000","last_became_peered":"2024-08-17T02:29:09.482881+0000","last_unstale":"2024-08-17T02:29:09.485281+0000","last_undegraded":"2024-08-17T02:29:09.485281+0000","last_fullsized":"2024-08-17T02:29:09.485281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501264+0000","last_change":"2024-08-17T02:29:09.498492+0000","last_active":"2024-08-17T02:29:09.501264+0000","last_peered":"2024-08-17T02:29:09.501264+0000","last_clean":"2024-08-17T02:29:09.501264+0000","last_became_active":"2024-08-17T02:29:09.498236+0000","last_became_peered":"2024-08-17T02:29:09.498236+0000","last_unstale":"2024-08-17T02:29:09.501264+0000","last_undegraded":"2024-08-17T02:29:09.501264+0000","last_fullsized":"2024-08-17T02:29:09.501264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500552+0000","last_change":"2024-08-17T02:29:09.496176+0000","last_active":"2024-08-17T02:29:09.500552+0000","last_peered":"2024-08-17T02:29:09.500552+0000","last_clean":"2024-08-17T02:29:09.500552+0000","last_became_active":"2024-08-17T02:29:09.495922+0000","last_became_peered":"2024-08-17T02:29:09.495922+0000","last_unstale":"2024-08-17T02:29:09.500552+0000","last_undegraded":"2024-08-17T02:29:09.500552+0000","last_fullsized":"2024-08-17T02:29:09.500552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.478155+0000","last_change":"2024-08-17T02:29:09.476022+0000","last_active":"2024-08-17T02:29:09.478155+0000","last_peered":"2024-08-17T02:29:09.478155+0000","last_clean":"2024-08-17T02:29:09.478155+0000","last_became_active":"2024-08-17T02:29:09.475294+0000","last_became_peered":"2024-08-17T02:29:09.475294+0000","last_unstale":"2024-08-17T02:29:09.478155+0000","last_undegraded":"2024-08-17T02:29:09.478155+0000","last_fullsized":"2024-08-17T02:29:09.478155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:16.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503872+0000","last_change":"2024-08-17T02:29:09.500224+0000","last_active":"2024-08-17T02:29:09.503872+0000","last_peered":"2024-08-17T02:29:09.503872+0000","last_clean":"2024-08-17T02:29:09.503872+0000","last_became_active":"2024-08-17T02:29:09.495511+0000","last_became_peered":"2024-08-17T02:29:09.495511+0000","last_unstale":"2024-08-17T02:29:09.503872+0000","last_undegraded":"2024-08-17T02:29:09.503872+0000","last_fullsized":"2024-08-17T02:29:09.503872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499576+0000","last_change":"2024-08-17T02:29:09.491171+0000","last_active":"2024-08-17T02:29:09.499576+0000","last_peered":"2024-08-17T02:29:09.499576+0000","last_clean":"2024-08-17T02:29:09.499576+0000","last_became_active":"2024-08-17T02:29:09.490441+0000","last_became_peered":"2024-08-17T02:29:09.490441+0000","last_unstale":"2024-08-17T02:29:09.499576+0000","last_undegraded":"2024-08-17T02:29:09.499576+0000","last_fullsized":"2024-08-17T02:29:09.499576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477202+0000","last_change":"2024-08-17T02:29:09.473529+0000","last_active":"2024-08-17T02:29:09.477202+0000","last_peered":"2024-08-17T02:29:09.477202+0000","last_clean":"2024-08-17T02:29:09.477202+0000","last_became_active":"2024-08-17T02:29:09.473153+0000","last_became_peered":"2024-08-17T02:29:09.473153+0000","last_unstale":"2024-08-17T02:29:09.477202+0000","last_undegraded":"2024-08-17T02:29:09.477202+0000","last_fullsized":"2024-08-17T02:29:09.477202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492664+0000","last_change":"2024-08-17T02:29:09.490340+0000","last_active":"2024-08-17T02:29:09.492664+0000","last_peered":"2024-08-17T02:29:09.492664+0000","last_clean":"2024-08-17T02:29:09.492664+0000","last_became_active":"2024-08-17T02:29:09.489870+0000","last_became_peered":"2024-08-17T02:29:09.489870+0000","last_unstale":"2024-08-17T02:29:09.492664+0000","last_undegraded":"2024-08-17T02:29:09.492664+0000","last_fullsized":"2024-08-17T02:29:09.492664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481752+0000","last_change":"2024-08-17T02:29:09.472840+0000","last_active":"2024-08-17T02:29:09.481752+0000","last_peered":"2024-08-17T02:29:09.481752+0000","last_clean":"2024-08-17T02:29:09.481752+0000","last_became_active":"2024-08-17T02:29:09.472553+0000","last_became_peered":"2024-08-17T02:29:09.472553+0000","last_unstale":"2024-08-17T02:29:09.481752+0000","last_undegraded":"2024-08-17T02:29:09.481752+0000","last_fullsized":"2024-08-17T02:29:09.481752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486135+0000","last_change":"2024-08-17T02:29:09.482798+0000","last_active":"2024-08-17T02:29:09.486135+0000","last_peered":"2024-08-17T02:29:09.486135+0000","last_clean":"2024-08-17T02:29:09.486135+0000","last_became_active":"2024-08-17T02:29:09.480991+0000","last_became_peered":"2024-08-17T02:29:09.480991+0000","last_unstale":"2024-08-17T02:29:09.486135+0000","last_undegraded":"2024-08-17T02:29:09.486135+0000","last_fullsized":"2024-08-17T02:29:09.486135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483656+0000","last_change":"2024-08-17T02:29:09.481066+0000","last_active":"2024-08-17T02:29:09.483656+0000","last_peered":"2024-08-17T02:29:09.483656+0000","last_clean":"2024-08-17T02:29:09.483656+0000","last_became_active":"2024-08-17T02:29:09.480760+0000","last_became_peered":"2024-08-17T02:29:09.480760+0000","last_unstale":"2024-08-17T02:29:09.483656+0000","last_undegraded":"2024-08-17T02:29:09.483656+0000","last_fullsized":"2024-08-17T02:29:09.483656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489725+0000","last_change":"2024-08-17T02:29:09.481328+0000","last_active":"2024-08-17T02:29:09.489725+0000","last_peered":"2024-08-17T02:29:09.489725+0000","last_clean":"2024-08-17T02:29:09.489725+0000","last_became_active":"2024-08-17T02:29:09.480207+0000","last_became_peered":"2024-08-17T02:29:09.480207+0000","last_unstale":"2024-08-17T02:29:09.489725+0000","last_undegraded":"2024-08-17T02:29:09.489725+0000","last_fullsized":"2024-08-17T02:29:09.489725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495304+0000","last_change":"2024-08-17T02:29:09.493921+0000","last_active":"2024-08-17T02:29:09.495304+0000","last_peered":"2024-08-17T02:29:09.495304+0000","last_clean":"2024-08-17T02:29:09.495304+0000","last_became_active":"2024-08-17T02:29:09.493466+0000","last_became_peered":"2024-08-17T02:29:09.493466+0000","last_unstale":"2024-08-17T02:29:09.495304+0000","last_undegraded":"2024-08-17T02:29:09.495304+0000","last_fullsized":"2024-08-17T02:29:09.495304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486278+0000","last_change":"2024-08-17T02:29:09.473340+0000","last_active":"2024-08-17T02:29:09.486278+0000","last_peered":"2024-08-17T02:29:09.486278+0000","last_clean":"2024-08-17T02:29:09.486278+0000","last_became_active":"2024-08-17T02:29:09.473031+0000","last_became_peered":"2024-08-17T02:29:09.473031+0000","last_unstale":"2024-08-17T02:29:09.486278+0000","last_undegraded":"2024-08-17T02:29:09.486278+0000","last_fullsized":"2024-08-17T02:29:09.486278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473205+0000","last_change":"2024-08-17T02:29:09.469323+0000","last_active":"2024-08-17T02:29:09.473205+0000","last_peered":"2024-08-17T02:29:09.473205+0000","last_clean":"2024-08-17T02:29:09.473205+0000","last_became_active":"2024-08-17T02:29:09.468822+0000","last_became_peered":"2024-08-17T02:29:09.468822+0000","last_unstale":"2024-08-17T02:29:09.473205+0000","last_undegraded":"2024-08-17T02:29:09.473205+0000","last_fullsized":"2024-08-17T02:29:09.473205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492646+0000","last_change":"2024-08-17T02:29:09.490137+0000","last_active":"2024-08-17T02:29:09.492646+0000","last_peered":"2024-08-17T02:29:09.492646+0000","last_clean":"2024-08-17T02:29:09.492646+0000","last_became_active":"2024-08-17T02:29:09.489622+0000","last_became_peered":"2024-08-17T02:29:09.489622+0000","last_unstale":"2024-08-17T02:29:09.492646+0000","last_undegraded":"2024-08-17T02:29:09.492646+0000","last_fullsized":"2024-08-17T02:29:09.492646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483236+0000","last_change":"2024-08-17T02:29:09.481874+0000","last_active":"2024-08-17T02:29:09.483236+0000","last_peered":"2024-08-17T02:29:09.483236+0000","last_clean":"2024-08-17T02:29:09.483236+0000","last_became_active":"2024-08-17T02:29:09.481627+0000","last_became_peered":"2024-08-17T02:29:09.481627+0000","last_unstale":"2024-08-17T02:29:09.483236+0000","last_undegraded":"2024-08-17T02:29:09.483236+0000","last_fullsized":"2024-08-17T02:29:09.483236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:54.522995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487202+0000","last_change":"2024-08-17T02:29:09.475428+0000","last_active":"2024-08-17T02:29:09.487202+0000","last_peered":"2024-08-17T02:29:09.487202+0000","last_clean":"2024-08-17T02:29:09.487202+0000","last_became_active":"2024-08-17T02:29:09.474993+0000","last_became_peered":"2024-08-17T02:29:09.474993+0000","last_unstale":"2024-08-17T02:29:09.487202+0000","last_undegraded":"2024-08-17T02:29:09.487202+0000","last_fullsized":"2024-08-17T02:29:09.487202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484961+0000","last_change":"2024-08-17T02:29:09.478702+0000","last_active":"2024-08-17T02:29:09.484961+0000","last_peered":"2024-08-17T02:29:09.484961+0000","last_clean":"2024-08-17T02:29:09.484961+0000","last_became_active":"2024-08-17T02:29:09.478413+0000","last_became_peered":"2024-08-17T02:29:09.478413+0000","last_unstale":"2024-08-17T02:29:09.484961+0000","last_undegraded":"2024-08-17T02:29:09.484961+0000","last_fullsized":"2024-08-17T02:29:09.484961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:49.001606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504251+0000","last_change":"2024-08-17T02:29:08.470650+0000","last_active":"2024-08-17T02:29:09.504251+0000","last_peered":"2024-08-17T02:29:09.504251+0000","last_clean":"2024-08-17T02:29:09.504251+0000","last_became_active":"2024-08-17T02:29:08.470347+0000","last_became_peered":"2024-08-17T02:29:08.470347+0000","last_unstale":"2024-08-17T02:29:09.504251+0000","last_undegraded":"2024-08-17T02:29:09.504251+0000","last_fullsized":"2024-08-17T02:29:09.504251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477184+0000","last_change":"2024-08-17T02:29:09.472832+0000","last_active":"2024-08-17T02:29:09.477184+0000","last_peered":"2024-08-17T02:29:09.477184+0000","last_clean":"2024-08-17T02:29:09.477184+0000","last_became_active":"2024-08-17T02:29:09.472581+0000","last_became_peered":"2024-08-17T02:29:09.472581+0000","last_unstale":"2024-08-17T02:29:09.477184+0000","last_undegraded":"2024-08-17T02:29:09.477184+0000","last_fullsized":"2024-08-17T02:29:09.477184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501308+0000","last_change":"2024-08-17T02:29:08.460904+0000","last_active":"2024-08-17T02:29:09.501308+0000","last_peered":"2024-08-17T02:29:09.501308+0000","last_clean":"2024-08-17T02:29:09.501308+0000","last_became_active":"2024-08-17T02:29:08.458813+0000","last_became_peered":"2024-08-17T02:29:08.458813+0000","last_unstale":"2024-08-17T02:29:09.501308+0000","last_undegraded":"2024-08-17T02:29:09.501308+0000","last_fullsized":"2024-08-17T02:29:09.501308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.465640+0000","last_change":"2024-08-17T02:29:08.469946+0000","last_active":"2024-08-17T02:29:09.465640+0000","last_peered":"2024-08-17T02:29:09.465640+0000","last_clean":"2024-08-17T02:29:09.465640+0000","last_became_active":"2024-08-17T02:29:08.469719+0000","last_became_peered":"2024-08-17T02:29:08.469719+0000","last_unstale":"2024-08-17T02:29:09.465640+0000","last_undegraded":"2024-08-17T02:29:09.465640+0000","last_fullsized":"2024-08-17T02:29:09.465640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483357+0000","last_change":"2024-08-17T02:29:09.480169+0000","last_active":"2024-08-17T02:29:09.483357+0000","last_peered":"2024-08-17T02:29:09.483357+0000","last_clean":"2024-08-17T02:29:09.483357+0000","last_became_active":"2024-08-17T02:29:09.479899+0000","last_became_peered":"2024-08-17T02:29:09.479899+0000","last_unstale":"2024-08-17T02:29:09.483357+0000","last_undegraded":"2024-08-17T02:29:09.483357+0000","last_fullsized":"2024-08-17T02:29:09.483357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468522+0000","last_change":"2024-08-17T02:29:08.463843+0000","last_active":"2024-08-17T02:29:09.468522+0000","last_peered":"2024-08-17T02:29:09.468522+0000","last_clean":"2024-08-17T02:29:09.468522+0000","last_became_active":"2024-08-17T02:29:08.463583+0000","last_became_peered":"2024-08-17T02:29:08.463583+0000","last_unstale":"2024-08-17T02:29:09.468522+0000","last_undegraded":"2024-08-17T02:29:09.468522+0000","last_fullsized":"2024-08-17T02:29:09.468522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488064+0000","last_change":"2024-08-17T02:29:09.485700+0000","last_active":"2024-08-17T02:29:09.488064+0000","last_peered":"2024-08-17T02:29:09.488064+0000","last_clean":"2024-08-17T02:29:09.488064+0000","last_became_active":"2024-08-17T02:29:09.485419+0000","last_became_peered":"2024-08-17T02:29:09.485419+0000","last_unstale":"2024-08-17T02:29:09.488064+0000","last_undegraded":"2024-08-17T02:29:09.488064+0000","last_fullsized":"2024-08-17T02:29:09.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470817+0000","last_change":"2024-08-17T02:29:08.476092+0000","last_active":"2024-08-17T02:29:09.470817+0000","last_peered":"2024-08-17T02:29:09.470817+0000","last_clean":"2024-08-17T02:29:09.470817+0000","last_became_active":"2024-08-17T02:29:08.475723+0000","last_became_peered":"2024-08-17T02:29:08.475723+0000","last_unstale":"2024-08-17T02:29:09.470817+0000","last_undegraded":"2024-08-17T02:29:09.470817+0000","last_fullsized":"2024-08-17T02:29:09.470817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484090+0000","last_change":"2024-08-17T02:29:09.481568+0000","last_active":"2024-08-17T02:29:09.484090+0000","last_peered":"2024-08-17T02:29:09.484090+0000","last_clean":"2024-08-17T02:29:09.484090+0000","last_became_active":"2024-08-17T02:29:09.481252+0000","last_became_peered":"2024-08-17T02:29:09.481252+0000","last_unstale":"2024-08-17T02:29:09.484090+0000","last_undegraded":"2024-08-17T02:29:09.484090+0000","last_fullsized":"2024-08-17T02:29:09.484090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468015+0000","last_change":"2024-08-17T02:29:08.477837+0000","last_active":"2024-08-17T02:29:09.468015+0000","last_peered":"2024-08-17T02:29:09.468015+0000","last_clean":"2024-08-17T02:29:09.468015+0000","last_became_active":"2024-08-17T02:29:08.477381+0000","last_became_peered":"2024-08-17T02:29:08.477381+0000","last_unstale":"2024-08-17T02:29:09.468015+0000","last_undegraded":"2024-08-17T02:29:09.468015+0000","last_fullsized":"2024-08-17T02:29:09.468015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494137+0000","last_change":"2024-08-17T02:29:09.490274+0000","last_active":"2024-08-17T02:29:09.494137+0000","last_peered":"2024-08-17T02:29:09.494137+0000","last_clean":"2024-08-17T02:29:09.494137+0000","last_became_active":"2024-08-17T02:29:09.489910+0000","last_became_peered":"2024-08-17T02:29:09.489910+0000","last_unstale":"2024-08-17T02:29:09.494137+0000","last_undegraded":"2024-08-17T02:29:09.494137+0000","last_fullsized":"2024-08-17T02:29:09.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495817+0000","last_change":"2024-08-17T02:29:08.470400+0000","last_active":"2024-08-17T02:29:09.495817+0000","last_peered":"2024-08-17T02:29:09.495817+0000","last_clean":"2024-08-17T02:29:09.495817+0000","last_became_active":"2024-08-17T02:29:08.470132+0000","last_became_peered":"2024-08-17T02:29:08.470132+0000","last_unstale":"2024-08-17T02:29:09.495817+0000","last_undegraded":"2024-08-17T02:29:09.495817+0000","last_fullsized":"2024-08-17T02:29:09.495817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483484+0000","last_change":"2024-08-17T02:29:09.476627+0000","last_active":"2024-08-17T02:29:09.483484+0000","last_peered":"2024-08-17T02:29:09.483484+0000","last_clean":"2024-08-17T02:29:09.483484+0000","last_became_active":"2024-08-17T02:29:09.475796+0000","last_became_peered":"2024-08-17T02:29:09.475796+0000","last_unstale":"2024-08-17T02:29:09.483484+0000","last_undegraded":"2024-08-17T02:29:09.483484+0000","last_fullsized":"2024-08-17T02:29:09.483484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.793675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.506084+0000","last_change":"2024-08-17T02:29:08.476918+0000","last_active":"2024-08-17T02:29:09.506084+0000","last_peered":"2024-08-17T02:29:09.506084+0000","last_clean":"2024-08-17T02:29:09.506084+0000","last_became_active":"2024-08-17T02:29:08.476398+0000","last_became_peered":"2024-08-17T02:29:08.476398+0000","last_unstale":"2024-08-17T02:29:09.506084+0000","last_undegraded":"2024-08-17T02:29:09.506084+0000","last_fullsized":"2024-08-17T02:29:09.506084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503892+0000","last_change":"2024-08-17T02:29:09.502218+0000","last_active":"2024-08-17T02:29:09.503892+0000","last_peered":"2024-08-17T02:29:09.503892+0000","last_clean":"2024-08-17T02:29:09.503892+0000","last_became_active":"2024-08-17T02:29:09.495867+0000","last_became_peered":"2024-08-17T02:29:09.495867+0000","last_unstale":"2024-08-17T02:29:09.503892+0000","last_undegraded":"2024-08-17T02:29:09.503892+0000","last_fullsized":"2024-08-17T02:29:09.503892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500523+0000","last_change":"2024-08-17T02:29:08.456255+0000","last_active":"2024-08-17T02:29:09.500523+0000","last_peered":"2024-08-17T02:29:09.500523+0000","last_clean":"2024-08-17T02:29:09.500523+0000","last_became_active":"2024-08-17T02:29:08.455951+0000","last_became_peered":"2024-08-17T02:29:08.455951+0000","last_unstale":"2024-08-17T02:29:09.500523+0000","last_undegraded":"2024-08-17T02:29:09.500523+0000","last_fullsized":"2024-08-17T02:29:09.500523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494299+0000","last_change":"2024-08-17T02:29:09.491084+0000","last_active":"2024-08-17T02:29:09.494299+0000","last_peered":"2024-08-17T02:29:09.494299+0000","last_clean":"2024-08-17T02:29:09.494299+0000","last_became_active":"2024-08-17T02:29:09.486223+0000","last_became_peered":"2024-08-17T02:29:09.486223+0000","last_unstale":"2024-08-17T02:29:09.494299+0000","last_undegraded":"2024-08-17T02:29:09.494299+0000","last_fullsized":"2024-08-17T02:29:09.494299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488081+0000","last_change":"2024-08-17T02:29:08.472582+0000","last_active":"2024-08-17T02:29:09.488081+0000","last_peered":"2024-08-17T02:29:09.488081+0000","last_clean":"2024-08-17T02:29:09.488081+0000","last_became_active":"2024-08-17T02:29:08.472353+0000","last_became_peered":"2024-08-17T02:29:08.472353+0000","last_unstale":"2024-08-17T02:29:09.488081+0000","last_undegraded":"2024-08-17T02:29:09.488081+0000","last_fullsized":"2024-08-17T02:29:09.488081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503846+0000","last_change":"2024-08-17T02:29:09.492684+0000","last_active":"2024-08-17T02:29:09.503846+0000","last_peered":"2024-08-17T02:29:09.503846+0000","last_clean":"2024-08-17T02:29:09.503846+0000","last_became_active":"2024-08-17T02:29:09.492444+0000","last_became_peered":"2024-08-17T02:29:09.492444+0000","last_unstale":"2024-08-17T02:29:09.503846+0000","last_undegraded":"2024-08-17T02:29:09.503846+0000","last_fullsized":"2024-08-17T02:29:09.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470244+0000","last_change":"2024-08-17T02:29:08.475729+0000","last_active":"2024-08-17T02:29:09.470244+0000","last_peered":"2024-08-17T02:29:09.470244+0000","last_clean":"2024-08-17T02:29:09.470244+0000","last_became_active":"2024-08-17T02:29:08.475476+0000","last_became_peered":"2024-08-17T02:29:08.475476+0000","last_unstale":"2024-08-17T02:29:09.470244+0000","last_undegraded":"2024-08-17T02:29:09.470244+0000","last_fullsized":"2024-08-17T02:29:09.470244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487181+0000","last_change":"2024-08-17T02:29:09.475265+0000","last_active":"2024-08-17T02:29:09.487181+0000","last_peered":"2024-08-17T02:29:09.487181+0000","last_clean":"2024-08-17T02:29:09.487181+0000","last_became_active":"2024-08-17T02:29:09.474621+0000","last_became_peered":"2024-08-17T02:29:09.474621+0000","last_unstale":"2024-08-17T02:29:09.487181+0000","last_undegraded":"2024-08-17T02:29:09.487181+0000","last_fullsized":"2024-08-17T02:29:09.487181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496446+0000","last_change":"2024-08-17T02:29:08.461859+0000","last_active":"2024-08-17T02:29:09.496446+0000","last_peered":"2024-08-17T02:29:09.496446+0000","last_clean":"2024-08-17T02:29:09.496446+0000","last_became_active":"2024-08-17T02:29:08.461535+0000","last_became_peered":"2024-08-17T02:29:08.461535+0000","last_unstale":"2024-08-17T02:29:09.496446+0000","last_undegraded":"2024-08-17T02:29:09.496446+0000","last_fullsized":"2024-08-17T02:29:09.496446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501548+0000","last_change":"2024-08-17T02:29:09.491129+0000","last_active":"2024-08-17T02:29:09.501548+0000","last_peered":"2024-08-17T02:29:09.501548+0000","last_clean":"2024-08-17T02:29:09.501548+0000","last_became_active":"2024-08-17T02:29:09.490847+0000","last_became_peered":"2024-08-17T02:29:09.490847+0000","last_unstale":"2024-08-17T02:29:09.501548+0000","last_undegraded":"2024-08-17T02:29:09.501548+0000","last_fullsized":"2024-08-17T02:29:09.501548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496485+0000","last_change":"2024-08-17T02:29:08.457588+0000","last_active":"2024-08-17T02:29:09.496485+0000","last_peered":"2024-08-17T02:29:09.496485+0000","last_clean":"2024-08-17T02:29:09.496485+0000","last_became_active":"2024-08-17T02:29:08.457346+0000","last_became_peered":"2024-08-17T02:29:08.457346+0000","last_unstale":"2024-08-17T02:29:09.496485+0000","last_undegraded":"2024-08-17T02:29:09.496485+0000","last_fullsized":"2024-08-17T02:29:09.496485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:08.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502379+0000","last_change":"2024-08-17T02:29:09.494028+0000","last_active":"2024-08-17T02:29:09.502379+0000","last_peered":"2024-08-17T02:29:09.502379+0000","last_clean":"2024-08-17T02:29:09.502379+0000","last_became_active":"2024-08-17T02:29:09.493737+0000","last_became_peered":"2024-08-17T02:29:09.493737+0000","last_unstale":"2024-08-17T02:29:09.502379+0000","last_undegraded":"2024-08-17T02:29:09.502379+0000","last_fullsized":"2024-08-17T02:29:09.502379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.491687+0000","last_change":"2024-08-17T02:29:08.466598+0000","last_active":"2024-08-17T02:29:09.491687+0000","last_peered":"2024-08-17T02:29:09.491687+0000","last_clean":"2024-08-17T02:29:09.491687+0000","last_became_active":"2024-08-17T02:29:08.466312+0000","last_became_peered":"2024-08-17T02:29:08.466312+0000","last_unstale":"2024-08-17T02:29:09.491687+0000","last_undegraded":"2024-08-17T02:29:09.491687+0000","last_fullsized":"2024-08-17T02:29:09.491687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504407+0000","last_change":"2024-08-17T02:29:09.503142+0000","last_active":"2024-08-17T02:29:09.504407+0000","last_peered":"2024-08-17T02:29:09.504407+0000","last_clean":"2024-08-17T02:29:09.504407+0000","last_became_active":"2024-08-17T02:29:09.500631+0000","last_became_peered":"2024-08-17T02:29:09.500631+0000","last_unstale":"2024-08-17T02:29:09.504407+0000","last_undegraded":"2024-08-17T02:29:09.504407+0000","last_fullsized":"2024-08-17T02:29:09.504407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496744+0000","last_change":"2024-08-17T02:29:08.461264+0000","last_active":"2024-08-17T02:29:09.496744+0000","last_peered":"2024-08-17T02:29:09.496744+0000","last_clean":"2024-08-17T02:29:09.496744+0000","last_became_active":"2024-08-17T02:29:08.460980+0000","last_became_peered":"2024-08-17T02:29:08.460980+0000","last_unstale":"2024-08-17T02:29:09.496744+0000","last_undegraded":"2024-08-17T02:29:09.496744+0000","last_fullsized":"2024-08-17T02:29:09.496744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494761+0000","last_change":"2024-08-17T02:29:09.491641+0000","last_active":"2024-08-17T02:29:09.494761+0000","last_peered":"2024-08-17T02:29:09.494761+0000","last_clean":"2024-08-17T02:29:09.494761+0000","last_became_active":"2024-08-17T02:29:09.491430+0000","last_became_peered":"2024-08-17T02:29:09.491430+0000","last_unstale":"2024-08-17T02:29:09.494761+0000","last_undegraded":"2024-08-17T02:29:09.494761+0000","last_fullsized":"2024-08-17T02:29:09.494761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466879+0000","last_change":"2024-08-17T02:29:08.471744+0000","last_active":"2024-08-17T02:29:09.466879+0000","last_peered":"2024-08-17T02:29:09.466879+0000","last_clean":"2024-08-17T02:29:09.466879+0000","last_became_active":"2024-08-17T02:29:08.471449+0000","last_became_peered":"2024-08-17T02:29:08.471449+0000","last_unstale":"2024-08-17T02:29:09.466879+0000","last_undegraded":"2024-08-17T02:29:09.466879+0000","last_fullsized":"2024-08-17T02:29:09.466879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504380+0000","last_change":"2024-08-17T02:29:09.502714+0000","last_active":"2024-08-17T02:29:09.504380+0000","last_peered":"2024-08-17T02:29:09.504380+0000","last_clean":"2024-08-17T02:29:09.504380+0000","last_became_active":"2024-08-17T02:29:09.502509+0000","last_became_peered":"2024-08-17T02:29:09.502509+0000","last_unstale":"2024-08-17T02:29:09.504380+0000","last_undegraded":"2024-08-17T02:29:09.504380+0000","last_fullsized":"2024-08-17T02:29:09.504380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:11.241240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475314+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:09.475314+0000","last_peered":"2024-08-17T02:29:09.475314+0000","last_clean":"2024-08-17T02:29:09.475314+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:09.475314+0000","last_undegraded":"2024-08-17T02:29:09.475314+0000","last_fullsized":"2024-08-17T02:29:09.475314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472401+0000","last_change":"2024-08-17T02:29:08.460254+0000","last_active":"2024-08-17T02:29:09.472401+0000","last_peered":"2024-08-17T02:29:09.472401+0000","last_clean":"2024-08-17T02:29:09.472401+0000","last_became_active":"2024-08-17T02:29:08.459985+0000","last_became_peered":"2024-08-17T02:29:08.459985+0000","last_unstale":"2024-08-17T02:29:09.472401+0000","last_undegraded":"2024-08-17T02:29:09.472401+0000","last_fullsized":"2024-08-17T02:29:09.472401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499667+0000","last_change":"2024-08-17T02:29:09.498589+0000","last_active":"2024-08-17T02:29:09.499667+0000","last_peered":"2024-08-17T02:29:09.499667+0000","last_clean":"2024-08-17T02:29:09.499667+0000","last_became_active":"2024-08-17T02:29:09.498056+0000","last_became_peered":"2024-08-17T02:29:09.498056+0000","last_unstale":"2024-08-17T02:29:09.499667+0000","last_undegraded":"2024-08-17T02:29:09.499667+0000","last_fullsized":"2024-08-17T02:29:09.499667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475226+0000","last_change":"2024-08-17T02:29:08.470766+0000","last_active":"2024-08-17T02:29:09.475226+0000","last_peered":"2024-08-17T02:29:09.475226+0000","last_clean":"2024-08-17T02:29:09.475226+0000","last_became_active":"2024-08-17T02:29:08.470301+0000","last_became_peered":"2024-08-17T02:29:08.470301+0000","last_unstale":"2024-08-17T02:29:09.475226+0000","last_undegraded":"2024-08-17T02:29:09.475226+0000","last_fullsized":"2024-08-17T02:29:09.475226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472473+0000","last_change":"2024-08-17T02:29:09.465345+0000","last_active":"2024-08-17T02:29:09.472473+0000","last_peered":"2024-08-17T02:29:09.472473+0000","last_clean":"2024-08-17T02:29:09.472473+0000","last_became_active":"2024-08-17T02:29:09.465075+0000","last_became_peered":"2024-08-17T02:29:09.465075+0000","last_unstale":"2024-08-17T02:29:09.472473+0000","last_undegraded":"2024-08-17T02:29:09.472473+0000","last_fullsized":"2024-08-17T02:29:09.472473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466876+0000","last_change":"2024-08-17T02:29:08.473928+0000","last_active":"2024-08-17T02:29:09.466876+0000","last_peered":"2024-08-17T02:29:09.466876+0000","last_clean":"2024-08-17T02:29:09.466876+0000","last_became_active":"2024-08-17T02:29:08.473189+0000","last_became_peered":"2024-08-17T02:29:08.473189+0000","last_unstale":"2024-08-17T02:29:09.466876+0000","last_undegraded":"2024-08-17T02:29:09.466876+0000","last_fullsized":"2024-08-17T02:29:09.466876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.479531+0000","last_change":"2024-08-17T02:29:09.477076+0000","last_active":"2024-08-17T02:29:09.479531+0000","last_peered":"2024-08-17T02:29:09.479531+0000","last_clean":"2024-08-17T02:29:09.479531+0000","last_became_active":"2024-08-17T02:29:09.476789+0000","last_became_peered":"2024-08-17T02:29:09.476789+0000","last_unstale":"2024-08-17T02:29:09.479531+0000","last_undegraded":"2024-08-17T02:29:09.479531+0000","last_fullsized":"2024-08-17T02:29:09.479531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488186+0000","last_change":"2024-08-17T02:29:08.472166+0000","last_active":"2024-08-17T02:29:09.488186+0000","last_peered":"2024-08-17T02:29:09.488186+0000","last_clean":"2024-08-17T02:29:09.488186+0000","last_became_active":"2024-08-17T02:29:08.471933+0000","last_became_peered":"2024-08-17T02:29:08.471933+0000","last_unstale":"2024-08-17T02:29:09.488186+0000","last_undegraded":"2024-08-17T02:29:09.488186+0000","last_fullsized":"2024-08-17T02:29:09.488186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484642+0000","last_change":"2024-08-17T02:29:09.478904+0000","last_active":"2024-08-17T02:29:09.484642+0000","last_peered":"2024-08-17T02:29:09.484642+0000","last_clean":"2024-08-17T02:29:09.484642+0000","last_became_active":"2024-08-17T02:29:09.476164+0000","last_became_peered":"2024-08-17T02:29:09.476164+0000","last_unstale":"2024-08-17T02:29:09.484642+0000","last_undegraded":"2024-08-17T02:29:09.484642+0000","last_fullsized":"2024-08-17T02:29:09.484642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:06.838621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474425+0000","last_change":"2024-08-17T02:29:08.461319+0000","last_active":"2024-08-17T02:29:09.474425+0000","last_peered":"2024-08-17T02:29:09.474425+0000","last_clean":"2024-08-17T02:29:09.474425+0000","last_became_active":"2024-08-17T02:29:08.460994+0000","last_became_peered":"2024-08-17T02:29:08.460994+0000","last_unstale":"2024-08-17T02:29:09.474425+0000","last_undegraded":"2024-08-17T02:29:09.474425+0000","last_fullsized":"2024-08-17T02:29:09.474425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501176+0000","last_change":"2024-08-17T02:29:09.498026+0000","last_active":"2024-08-17T02:29:09.501176+0000","last_peered":"2024-08-17T02:29:09.501176+0000","last_clean":"2024-08-17T02:29:09.501176+0000","last_became_active":"2024-08-17T02:29:09.497741+0000","last_became_peered":"2024-08-17T02:29:09.497741+0000","last_unstale":"2024-08-17T02:29:09.501176+0000","last_undegraded":"2024-08-17T02:29:09.501176+0000","last_fullsized":"2024-08-17T02:29:09.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484472+0000","last_change":"2024-08-17T02:29:08.471249+0000","last_active":"2024-08-17T02:29:09.484472+0000","last_peered":"2024-08-17T02:29:09.484472+0000","last_clean":"2024-08-17T02:29:09.484472+0000","last_became_active":"2024-08-17T02:29:08.470658+0000","last_became_peered":"2024-08-17T02:29:08.470658+0000","last_unstale":"2024-08-17T02:29:09.484472+0000","last_undegraded":"2024-08-17T02:29:09.484472+0000","last_fullsized":"2024-08-17T02:29:09.484472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477525+0000","last_change":"2024-08-17T02:29:09.475433+0000","last_active":"2024-08-17T02:29:09.477525+0000","last_peered":"2024-08-17T02:29:09.477525+0000","last_clean":"2024-08-17T02:29:09.477525+0000","last_became_active":"2024-08-17T02:29:09.475166+0000","last_became_peered":"2024-08-17T02:29:09.475166+0000","last_unstale":"2024-08-17T02:29:09.477525+0000","last_undegraded":"2024-08-17T02:29:09.477525+0000","last_fullsized":"2024-08-17T02:29:09.477525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.474088+0000","last_change":"2024-08-17T02:29:08.473436+0000","last_active":"2024-08-17T02:29:10.474088+0000","last_peered":"2024-08-17T02:29:10.474088+0000","last_clean":"2024-08-17T02:29:10.474088+0000","last_became_active":"2024-08-17T02:29:08.473221+0000","last_became_peered":"2024-08-17T02:29:08.473221+0000","last_unstale":"2024-08-17T02:29:10.474088+0000","last_undegraded":"2024-08-17T02:29:10.474088+0000","last_fullsized":"2024-08-17T02:29:10.474088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483637+0000","last_change":"2024-08-17T02:29:09.480720+0000","last_active":"2024-08-17T02:29:09.483637+0000","last_peered":"2024-08-17T02:29:09.483637+0000","last_clean":"2024-08-17T02:29:09.483637+0000","last_became_active":"2024-08-17T02:29:09.480335+0000","last_became_peered":"2024-08-17T02:29:09.480335+0000","last_unstale":"2024-08-17T02:29:09.483637+0000","last_undegraded":"2024-08-17T02:29:09.483637+0000","last_fullsized":"2024-08-17T02:29:09.483637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504904+0000","last_change":"2024-08-17T02:29:08.473608+0000","last_active":"2024-08-17T02:29:09.504904+0000","last_peered":"2024-08-17T02:29:09.504904+0000","last_clean":"2024-08-17T02:29:09.504904+0000","last_became_active":"2024-08-17T02:29:08.473188+0000","last_became_peered":"2024-08-17T02:29:08.473188+0000","last_unstale":"2024-08-17T02:29:09.504904+0000","last_undegraded":"2024-08-17T02:29:09.504904+0000","last_fullsized":"2024-08-17T02:29:09.504904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494131+0000","last_change":"2024-08-17T02:29:09.488891+0000","last_active":"2024-08-17T02:29:09.494131+0000","last_peered":"2024-08-17T02:29:09.494131+0000","last_clean":"2024-08-17T02:29:09.494131+0000","last_became_active":"2024-08-17T02:29:09.486565+0000","last_became_peered":"2024-08-17T02:29:09.486565+0000","last_unstale":"2024-08-17T02:29:09.494131+0000","last_undegraded":"2024-08-17T02:29:09.494131+0000","last_fullsized":"2024-08-17T02:29:09.494131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475125+0000","last_change":"2024-08-17T02:29:08.470705+0000","last_active":"2024-08-17T02:29:09.475125+0000","last_peered":"2024-08-17T02:29:09.475125+0000","last_clean":"2024-08-17T02:29:09.475125+0000","last_became_active":"2024-08-17T02:29:08.469956+0000","last_became_peered":"2024-08-17T02:29:08.469956+0000","last_unstale":"2024-08-17T02:29:09.475125+0000","last_undegraded":"2024-08-17T02:29:09.475125+0000","last_fullsized":"2024-08-17T02:29:09.475125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481784+0000","last_change":"2024-08-17T02:29:09.473933+0000","last_active":"2024-08-17T02:29:09.481784+0000","last_peered":"2024-08-17T02:29:09.481784+0000","last_clean":"2024-08-17T02:29:09.481784+0000","last_became_active":"2024-08-17T02:29:09.473044+0000","last_became_peered":"2024-08-17T02:29:09.473044+0000","last_unstale":"2024-08-17T02:29:09.481784+0000","last_undegraded":"2024-08-17T02:29:09.481784+0000","last_fullsized":"2024-08-17T02:29:09.481784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.880794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473548+0000","last_change":"2024-08-17T02:29:08.470009+0000","last_active":"2024-08-17T02:29:09.473548+0000","last_peered":"2024-08-17T02:29:09.473548+0000","last_clean":"2024-08-17T02:29:09.473548+0000","last_became_active":"2024-08-17T02:29:08.469646+0000","last_became_peered":"2024-08-17T02:29:08.469646+0000","last_unstale":"2024-08-17T02:29:09.473548+0000","last_undegraded":"2024-08-17T02:29:09.473548+0000","last_fullsized":"2024-08-17T02:29:09.473548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483992+0000","last_change":"2024-08-17T02:29:09.481399+0000","last_active":"2024-08-17T02:29:09.483992+0000","last_peered":"2024-08-17T02:29:09.483992+0000","last_clean":"2024-08-17T02:29:09.483992+0000","last_became_active":"2024-08-17T02:29:09.481104+0000","last_became_peered":"2024-08-17T02:29:09.481104+0000","last_unstale":"2024-08-17T02:29:09.483992+0000","last_undegraded":"2024-08-17T02:29:09.483992+0000","last_fullsized":"2024-08-17T02:29:09.483992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473744+0000","last_change":"2024-08-17T02:29:08.468611+0000","last_active":"2024-08-17T02:29:09.473744+0000","last_peered":"2024-08-17T02:29:09.473744+0000","last_clean":"2024-08-17T02:29:09.473744+0000","last_became_active":"2024-08-17T02:29:08.468075+0000","last_became_peered":"2024-08-17T02:29:08.468075+0000","last_unstale":"2024-08-17T02:29:09.473744+0000","last_undegraded":"2024-08-17T02:29:09.473744+0000","last_fullsized":"2024-08-17T02:29:09.473744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483055+0000","last_change":"2024-08-17T02:29:09.474989+0000","last_active":"2024-08-17T02:29:09.483055+0000","last_peered":"2024-08-17T02:29:09.483055+0000","last_clean":"2024-08-17T02:29:09.483055+0000","last_became_active":"2024-08-17T02:29:09.474717+0000","last_became_peered":"2024-08-17T02:29:09.474717+0000","last_unstale":"2024-08-17T02:29:09.483055+0000","last_undegraded":"2024-08-17T02:29:09.483055+0000","last_fullsized":"2024-08-17T02:29:09.483055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494182+0000","last_change":"2024-08-17T02:29:08.474152+0000","last_active":"2024-08-17T02:29:09.494182+0000","last_peered":"2024-08-17T02:29:09.494182+0000","last_clean":"2024-08-17T02:29:09.494182+0000","last_became_active":"2024-08-17T02:29:08.473850+0000","last_became_peered":"2024-08-17T02:29:08.473850+0000","last_unstale":"2024-08-17T02:29:09.494182+0000","last_undegraded":"2024-08-17T02:29:09.494182+0000","last_fullsized":"2024-08-17T02:29:09.494182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489628+0000","last_change":"2024-08-17T02:29:09.480093+0000","last_active":"2024-08-17T02:29:09.489628+0000","last_peered":"2024-08-17T02:29:09.489628+0000","last_clean":"2024-08-17T02:29:09.489628+0000","last_became_active":"2024-08-17T02:29:09.472172+0000","last_became_peered":"2024-08-17T02:29:09.472172+0000","last_unstale":"2024-08-17T02:29:09.489628+0000","last_undegraded":"2024-08-17T02:29:09.489628+0000","last_fullsized":"2024-08-17T02:29:09.489628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499201+0000","last_change":"2024-08-17T02:29:09.494902+0000","last_active":"2024-08-17T02:29:09.499201+0000","last_peered":"2024-08-17T02:29:09.499201+0000","last_clean":"2024-08-17T02:29:09.499201+0000","last_became_active":"2024-08-17T02:29:09.491782+0000","last_became_peered":"2024-08-17T02:29:09.491782+0000","last_unstale":"2024-08-17T02:29:09.499201+0000","last_undegraded":"2024-08-17T02:29:09.499201+0000","last_fullsized":"2024-08-17T02:29:09.499201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502069+0000","last_change":"2024-08-17T02:29:08.475348+0000","last_active":"2024-08-17T02:29:09.502069+0000","last_peered":"2024-08-17T02:29:09.502069+0000","last_clean":"2024-08-17T02:29:09.502069+0000","last_became_active":"2024-08-17T02:29:08.475111+0000","last_became_peered":"2024-08-17T02:29:08.475111+0000","last_unstale":"2024-08-17T02:29:09.502069+0000","last_undegraded":"2024-08-17T02:29:09.502069+0000","last_fullsized":"2024-08-17T02:29:09.502069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:21:10.249183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.497333+0000","last_change":"2024-08-17T02:29:09.492777+0000","last_active":"2024-08-17T02:29:09.497333+0000","last_peered":"2024-08-17T02:29:09.497333+0000","last_clean":"2024-08-17T02:29:09.497333+0000","last_became_active":"2024-08-17T02:29:09.492531+0000","last_became_peered":"2024-08-17T02:29:09.492531+0000","last_unstale":"2024-08-17T02:29:09.497333+0000","last_undegraded":"2024-08-17T02:29:09.497333+0000","last_fullsized":"2024-08-17T02:29:09.497333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502308+0000","last_change":"2024-08-17T02:29:08.473691+0000","last_active":"2024-08-17T02:29:09.502308+0000","last_peered":"2024-08-17T02:29:09.502308+0000","last_clean":"2024-08-17T02:29:09.502308+0000","last_became_active":"2024-08-17T02:29:08.473411+0000","last_became_peered":"2024-08-17T02:29:08.473411+0000","last_unstale":"2024-08-17T02:29:09.502308+0000","last_undegraded":"2024-08-17T02:29:09.502308+0000","last_fullsized":"2024-08-17T02:29:09.502308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494186+0000","last_change":"2024-08-17T02:29:09.492743+0000","last_active":"2024-08-17T02:29:09.494186+0000","last_peered":"2024-08-17T02:29:09.494186+0000","last_clean":"2024-08-17T02:29:09.494186+0000","last_became_active":"2024-08-17T02:29:09.492489+0000","last_became_peered":"2024-08-17T02:29:09.492489+0000","last_unstale":"2024-08-17T02:29:09.494186+0000","last_undegraded":"2024-08-17T02:29:09.494186+0000","last_fullsized":"2024-08-17T02:29:09.494186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494368+0000","last_change":"2024-08-17T02:29:08.462205+0000","last_active":"2024-08-17T02:29:09.494368+0000","last_peered":"2024-08-17T02:29:09.494368+0000","last_clean":"2024-08-17T02:29:09.494368+0000","last_became_active":"2024-08-17T02:29:08.461965+0000","last_became_peered":"2024-08-17T02:29:08.461965+0000","last_unstale":"2024-08-17T02:29:09.494368+0000","last_undegraded":"2024-08-17T02:29:09.494368+0000","last_fullsized":"2024-08-17T02:29:09.494368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489475+0000","last_change":"2024-08-17T02:29:09.481257+0000","last_active":"2024-08-17T02:29:09.489475+0000","last_peered":"2024-08-17T02:29:09.489475+0000","last_clean":"2024-08-17T02:29:09.489475+0000","last_became_active":"2024-08-17T02:29:09.480977+0000","last_became_peered":"2024-08-17T02:29:09.480977+0000","last_unstale":"2024-08-17T02:29:09.489475+0000","last_undegraded":"2024-08-17T02:29:09.489475+0000","last_fullsized":"2024-08-17T02:29:09.489475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503649+0000","last_change":"2024-08-17T02:29:08.459843+0000","last_active":"2024-08-17T02:29:09.503649+0000","last_peered":"2024-08-17T02:29:09.503649+0000","last_clean":"2024-08-17T02:29:09.503649+0000","last_became_active":"2024-08-17T02:29:08.459311+0000","last_became_peered":"2024-08-17T02:29:08.459311+0000","last_unstale":"2024-08-17T02:29:09.503649+0000","last_undegraded":"2024-08-17T02:29:09.503649+0000","last_fullsized":"2024-08-17T02:29:09.503649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:14.102117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8170000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:18.558 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:18.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.740+0000 7f3af2600640 1 Processor -- start 2024-08-17T02:29:18.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.740+0000 7f3af2600640 1 -- start start 2024-08-17T02:29:18.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3af2600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 0x7f3aec0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3af2600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3aec06e800 0x7f3aec0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3af2600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec0afc10 con 0x7f3aec155180 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3af2600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec0aedf0 con 0x7f3aec06e800 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3af2600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0ae5b0 con 0x7f3aec0aea20 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3aec06e800 0x7f3aec0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3aec06e800 0x7f3aec0ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49202/0 (socket says 172.21.15.110:49202) 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 -- 172.21.15.110:0/1160485959 learned_addr learned my addr 172.21.15.110:0/1160485959 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aeb400640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 0x7f3aec0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 -- 172.21.15.110:0/1160485959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 msgr2=0x7f3aec0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 0x7f3aec0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 -- 172.21.15.110:0/1160485959 >> v1:172.21.15.177:6789/0 conn(0x7f3aec155180 legacy=0x7f3aec0acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:18.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aebe00640 1 -- 172.21.15.110:0/1160485959 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0af000 con 0x7f3aec06e800 2024-08-17T02:29:18.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.742+0000 7f3aeb400640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 0x7f3aec0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.743+0000 7f3aebe00640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec06e800 0x7f3aec0ad2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009f20 tx=0x7f3ae4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2694e27fd6f1623a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.743+0000 7f3aeaa00640 1 -- 172.21.15.110:0/1160485959 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4031400 con 0x7f3aec06e800 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3aeaa00640 1 -- 172.21.15.110:0/1160485959 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae402d050 con 0x7f3aec06e800 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3aeaa00640 1 -- 172.21.15.110:0/1160485959 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40317d0 con 0x7f3aec06e800 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 -- 172.21.15.110:0/1160485959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec06e800 msgr2=0x7f3aec0ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec06e800 0x7f3aec0ad2b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009f20 tx=0x7f3ae4009840 comp rx=0 tx=0).stop 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 -- 172.21.15.110:0/1160485959 shutdown_connections 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec06e800 0x7f3aec0ad2b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 --2- 172.21.15.110:0/1160485959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec0aea20 0x7f3aec0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 -- 172.21.15.110:0/1160485959 >> 172.21.15.110:0/1160485959 conn(0x7f3aec0cb9b0 msgr2=0x7f3aec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 -- 172.21.15.110:0/1160485959 shutdown_connections 2024-08-17T02:29:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.744+0000 7f3af2600640 1 -- 172.21.15.110:0/1160485959 wait complete. 2024-08-17T02:29:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.746+0000 7f3af2600640 1 Processor -- start 2024-08-17T02:29:18.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.746+0000 7f3af2600640 1 -- start start 2024-08-17T02:29:18.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.746+0000 7f3af2600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 0x7f3aec14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.746+0000 7f3af2600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3af2600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 0x7f3aec0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3af2600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec14f180 con 0x7f3aec0aea20 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3af2600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec1535f0 con 0x7f3aec155180 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3af2600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec1538d0 con 0x7f3aec06e800 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49208/0 (socket says 172.21.15.110:49208) 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 -- 172.21.15.110:0/3524769232 learned_addr learned my addr 172.21.15.110:0/3524769232 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3aebe00640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 0x7f3aec0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3aeb400640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 0x7f3aec14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 -- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 msgr2=0x7f3aec14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 0x7f3aec14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 -- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 msgr2=0x7f3aec0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 0x7f3aec0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 -- 172.21.15.110:0/3524769232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009ae0 con 0x7f3aec0aea20 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3aebe00640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 0x7f3aec0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3aeb400640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 0x7f3aec14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.747+0000 7f3ae2a00640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400b4f0 tx=0x7f3ad40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.748+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400f510 con 0x7f3aec0aea20 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.748+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad400f670 con 0x7f3aec0aea20 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.748+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec153bb0 con 0x7f3aec0aea20 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.748+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad400fa70 con 0x7f3aec0aea20 2024-08-17T02:29:18.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.748+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec168d60 con 0x7f3aec0aea20 2024-08-17T02:29:18.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.749+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec168fe0 con 0x7f3aec0aea20 2024-08-17T02:29:18.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.749+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ad401a400 con 0x7f3aec0aea20 2024-08-17T02:29:18.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.750+0000 7f3ae3400640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 0x7f3ac8067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:18.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.750+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3ad4081fc0 con 0x7f3aec0aea20 2024-08-17T02:29:18.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.750+0000 7f3aeb400640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 0x7f3ac8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:18.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.751+0000 7f3aeb400640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 0x7f3ac8067630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3adc008a80 tx=0x7f3adc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:18.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.754+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3aec168fe0 con 0x7f3aec0aea20 2024-08-17T02:29:18.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.927+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3aec168fe0 con 0x7f3ac8065180 2024-08-17T02:29:18.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.934+0000 7f3ae3400640 1 -- 172.21.15.110:0/3524769232 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264536 (secure 0 0 0) 0x7f3aec168fe0 con 0x7f3ac8065180 2024-08-17T02:29:18.939 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:18.940 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:29:18.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 msgr2=0x7f3ac8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 0x7f3ac8067630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3adc008a80 tx=0x7f3adc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 msgr2=0x7f3aec14c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ad400b4f0 tx=0x7f3ad40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 shutdown_connections 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3ac8065180 0x7f3ac8067630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3aec155180 0x7f3aec0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3aec0aea20 0x7f3aec14c480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 --2- 172.21.15.110:0/3524769232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3aec06e800 0x7f3aec14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 >> 172.21.15.110:0/3524769232 conn(0x7f3aec0cb9b0 msgr2=0x7f3aec0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:18.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 shutdown_connections 2024-08-17T02:29:18.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:18.938+0000 7f3af2600640 1 -- 172.21.15.110:0/3524769232 wait complete. 2024-08-17T02:29:18.953 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-08-17T02:29:17.438245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398492,"kb_used_data":2984,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576228,"statfs":{"total":773094113280,"available":770638057472,"internally_reserved":0,"allocated":3055616,"data_stored":1814180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002128"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503311+0000","last_change":"2024-08-17T02:29:09.500528+0000","last_active":"2024-08-17T02:29:09.503311+0000","last_peered":"2024-08-17T02:29:09.503311+0000","last_clean":"2024-08-17T02:29:09.503311+0000","last_became_active":"2024-08-17T02:29:09.500277+0000","last_became_peered":"2024-08-17T02:29:09.500277+0000","last_unstale":"2024-08-17T02:29:09.503311+0000","last_undegraded":"2024-08-17T02:29:09.503311+0000","last_fullsized":"2024-08-17T02:29:09.503311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494232+0000","last_change":"2024-08-17T02:29:09.488194+0000","last_active":"2024-08-17T02:29:09.494232+0000","last_peered":"2024-08-17T02:29:09.494232+0000","last_clean":"2024-08-17T02:29:09.494232+0000","last_became_active":"2024-08-17T02:29:09.487890+0000","last_became_peered":"2024-08-17T02:29:09.487890+0000","last_unstale":"2024-08-17T02:29:09.494232+0000","last_undegraded":"2024-08-17T02:29:09.494232+0000","last_fullsized":"2024-08-17T02:29:09.494232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.476701+0000","last_change":"2024-08-17T02:29:09.474732+0000","last_active":"2024-08-17T02:29:09.476701+0000","last_peered":"2024-08-17T02:29:09.476701+0000","last_clean":"2024-08-17T02:29:09.476701+0000","last_became_active":"2024-08-17T02:29:09.473873+0000","last_became_peered":"2024-08-17T02:29:09.473873+0000","last_unstale":"2024-08-17T02:29:09.476701+0000","last_undegraded":"2024-08-17T02:29:09.476701+0000","last_fullsized":"2024-08-17T02:29:09.476701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:33:05.177148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501146+0000","last_change":"2024-08-17T02:29:09.497768+0000","last_active":"2024-08-17T02:29:09.501146+0000","last_peered":"2024-08-17T02:29:09.501146+0000","last_clean":"2024-08-17T02:29:09.501146+0000","last_became_active":"2024-08-17T02:29:09.497468+0000","last_became_peered":"2024-08-17T02:29:09.497468+0000","last_unstale":"2024-08-17T02:29:09.501146+0000","last_undegraded":"2024-08-17T02:29:09.501146+0000","last_fullsized":"2024-08-17T02:29:09.501146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.505816+0000","last_change":"2024-08-17T02:29:09.503605+0000","last_active":"2024-08-17T02:29:09.505816+0000","last_peered":"2024-08-17T02:29:09.505816+0000","last_clean":"2024-08-17T02:29:09.505816+0000","last_became_active":"2024-08-17T02:29:09.503452+0000","last_became_peered":"2024-08-17T02:29:09.503452+0000","last_unstale":"2024-08-17T02:29:09.505816+0000","last_undegraded":"2024-08-17T02:29:09.505816+0000","last_fullsized":"2024-08-17T02:29:09.505816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:06.228551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501345+0000","last_change":"2024-08-17T02:29:09.498723+0000","last_active":"2024-08-17T02:29:09.501345+0000","last_peered":"2024-08-17T02:29:09.501345+0000","last_clean":"2024-08-17T02:29:09.501345+0000","last_became_active":"2024-08-17T02:29:09.498313+0000","last_became_peered":"2024-08-17T02:29:09.498313+0000","last_unstale":"2024-08-17T02:29:09.501345+0000","last_undegraded":"2024-08-17T02:29:09.501345+0000","last_fullsized":"2024-08-17T02:29:09.501345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502472+0000","last_change":"2024-08-17T02:29:09.494498+0000","last_active":"2024-08-17T02:29:09.502472+0000","last_peered":"2024-08-17T02:29:09.502472+0000","last_clean":"2024-08-17T02:29:09.502472+0000","last_became_active":"2024-08-17T02:29:09.494218+0000","last_became_peered":"2024-08-17T02:29:09.494218+0000","last_unstale":"2024-08-17T02:29:09.502472+0000","last_undegraded":"2024-08-17T02:29:09.502472+0000","last_fullsized":"2024-08-17T02:29:09.502472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492697+0000","last_change":"2024-08-17T02:29:09.491080+0000","last_active":"2024-08-17T02:29:09.492697+0000","last_peered":"2024-08-17T02:29:09.492697+0000","last_clean":"2024-08-17T02:29:09.492697+0000","last_became_active":"2024-08-17T02:29:09.490793+0000","last_became_peered":"2024-08-17T02:29:09.490793+0000","last_unstale":"2024-08-17T02:29:09.492697+0000","last_undegraded":"2024-08-17T02:29:09.492697+0000","last_fullsized":"2024-08-17T02:29:09.492697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503294+0000","last_change":"2024-08-17T02:29:09.498187+0000","last_active":"2024-08-17T02:29:09.503294+0000","last_peered":"2024-08-17T02:29:09.503294+0000","last_clean":"2024-08-17T02:29:09.503294+0000","last_became_active":"2024-08-17T02:29:09.491354+0000","last_became_peered":"2024-08-17T02:29:09.491354+0000","last_unstale":"2024-08-17T02:29:09.503294+0000","last_undegraded":"2024-08-17T02:29:09.503294+0000","last_fullsized":"2024-08-17T02:29:09.503294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:21.754886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494177+0000","last_change":"2024-08-17T02:29:09.484467+0000","last_active":"2024-08-17T02:29:09.494177+0000","last_peered":"2024-08-17T02:29:09.494177+0000","last_clean":"2024-08-17T02:29:09.494177+0000","last_became_active":"2024-08-17T02:29:09.483924+0000","last_became_peered":"2024-08-17T02:29:09.483924+0000","last_unstale":"2024-08-17T02:29:09.494177+0000","last_undegraded":"2024-08-17T02:29:09.494177+0000","last_fullsized":"2024-08-17T02:29:09.494177+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.490799+0000","last_change":"2024-08-17T02:29:09.483777+0000","last_active":"2024-08-17T02:29:09.490799+0000","last_peered":"2024-08-17T02:29:09.490799+0000","last_clean":"2024-08-17T02:29:09.490799+0000","last_became_active":"2024-08-17T02:29:09.483532+0000","last_became_peered":"2024-08-17T02:29:09.483532+0000","last_unstale":"2024-08-17T02:29:09.490799+0000","last_undegraded":"2024-08-17T02:29:09.490799+0000","last_fullsized":"2024-08-17T02:29:09.490799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484875+0000","last_change":"2024-08-17T02:29:09.482400+0000","last_active":"2024-08-17T02:29:09.484875+0000","last_peered":"2024-08-17T02:29:09.484875+0000","last_clean":"2024-08-17T02:29:09.484875+0000","last_became_active":"2024-08-17T02:29:09.482163+0000","last_became_peered":"2024-08-17T02:29:09.482163+0000","last_unstale":"2024-08-17T02:29:09.484875+0000","last_undegraded":"2024-08-17T02:29:09.484875+0000","last_fullsized":"2024-08-17T02:29:09.484875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:22.158713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483651+0000","last_change":"2024-08-17T02:29:09.481502+0000","last_active":"2024-08-17T02:29:09.483651+0000","last_peered":"2024-08-17T02:29:09.483651+0000","last_clean":"2024-08-17T02:29:09.483651+0000","last_became_active":"2024-08-17T02:29:09.481144+0000","last_became_peered":"2024-08-17T02:29:09.481144+0000","last_unstale":"2024-08-17T02:29:09.483651+0000","last_undegraded":"2024-08-17T02:29:09.483651+0000","last_fullsized":"2024-08-17T02:29:09.483651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494273+0000","last_change":"2024-08-17T02:29:09.485218+0000","last_active":"2024-08-17T02:29:09.494273+0000","last_peered":"2024-08-17T02:29:09.494273+0000","last_clean":"2024-08-17T02:29:09.494273+0000","last_became_active":"2024-08-17T02:29:09.484159+0000","last_became_peered":"2024-08-17T02:29:09.484159+0000","last_unstale":"2024-08-17T02:29:09.494273+0000","last_undegraded":"2024-08-17T02:29:09.494273+0000","last_fullsized":"2024-08-17T02:29:09.494273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:06:52.833765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.485281+0000","last_change":"2024-08-17T02:29:09.483147+0000","last_active":"2024-08-17T02:29:09.485281+0000","last_peered":"2024-08-17T02:29:09.485281+0000","last_clean":"2024-08-17T02:29:09.485281+0000","last_became_active":"2024-08-17T02:29:09.482881+0000","last_became_peered":"2024-08-17T02:29:09.482881+0000","last_unstale":"2024-08-17T02:29:09.485281+0000","last_undegraded":"2024-08-17T02:29:09.485281+0000","last_fullsized":"2024-08-17T02:29:09.485281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501264+0000","last_change":"2024-08-17T02:29:09.498492+0000","last_active":"2024-08-17T02:29:09.501264+0000","last_peered":"2024-08-17T02:29:09.501264+0000","last_clean":"2024-08-17T02:29:09.501264+0000","last_became_active":"2024-08-17T02:29:09.498236+0000","last_became_peered":"2024-08-17T02:29:09.498236+0000","last_unstale":"2024-08-17T02:29:09.501264+0000","last_undegraded":"2024-08-17T02:29:09.501264+0000","last_fullsized":"2024-08-17T02:29:09.501264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500552+0000","last_change":"2024-08-17T02:29:09.496176+0000","last_active":"2024-08-17T02:29:09.500552+0000","last_peered":"2024-08-17T02:29:09.500552+0000","last_clean":"2024-08-17T02:29:09.500552+0000","last_became_active":"2024-08-17T02:29:09.495922+0000","last_became_peered":"2024-08-17T02:29:09.495922+0000","last_unstale":"2024-08-17T02:29:09.500552+0000","last_undegraded":"2024-08-17T02:29:09.500552+0000","last_fullsized":"2024-08-17T02:29:09.500552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.478155+0000","last_change":"2024-08-17T02:29:09.476022+0000","last_active":"2024-08-17T02:29:09.478155+0000","last_peered":"2024-08-17T02:29:09.478155+0000","last_clean":"2024-08-17T02:29:09.478155+0000","last_became_active":"2024-08-17T02:29:09.475294+0000","last_became_peered":"2024-08-17T02:29:09.475294+0000","last_unstale":"2024-08-17T02:29:09.478155+0000","last_undegraded":"2024-08-17T02:29:09.478155+0000","last_fullsized":"2024-08-17T02:29:09.478155+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:16.985252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503872+0000","last_change":"2024-08-17T02:29:09.500224+0000","last_active":"2024-08-17T02:29:09.503872+0000","last_peered":"2024-08-17T02:29:09.503872+0000","last_clean":"2024-08-17T02:29:09.503872+0000","last_became_active":"2024-08-17T02:29:09.495511+0000","last_became_peered":"2024-08-17T02:29:09.495511+0000","last_unstale":"2024-08-17T02:29:09.503872+0000","last_undegraded":"2024-08-17T02:29:09.503872+0000","last_fullsized":"2024-08-17T02:29:09.503872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499576+0000","last_change":"2024-08-17T02:29:09.491171+0000","last_active":"2024-08-17T02:29:09.499576+0000","last_peered":"2024-08-17T02:29:09.499576+0000","last_clean":"2024-08-17T02:29:09.499576+0000","last_became_active":"2024-08-17T02:29:09.490441+0000","last_became_peered":"2024-08-17T02:29:09.490441+0000","last_unstale":"2024-08-17T02:29:09.499576+0000","last_undegraded":"2024-08-17T02:29:09.499576+0000","last_fullsized":"2024-08-17T02:29:09.499576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477202+0000","last_change":"2024-08-17T02:29:09.473529+0000","last_active":"2024-08-17T02:29:09.477202+0000","last_peered":"2024-08-17T02:29:09.477202+0000","last_clean":"2024-08-17T02:29:09.477202+0000","last_became_active":"2024-08-17T02:29:09.473153+0000","last_became_peered":"2024-08-17T02:29:09.473153+0000","last_unstale":"2024-08-17T02:29:09.477202+0000","last_undegraded":"2024-08-17T02:29:09.477202+0000","last_fullsized":"2024-08-17T02:29:09.477202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492664+0000","last_change":"2024-08-17T02:29:09.490340+0000","last_active":"2024-08-17T02:29:09.492664+0000","last_peered":"2024-08-17T02:29:09.492664+0000","last_clean":"2024-08-17T02:29:09.492664+0000","last_became_active":"2024-08-17T02:29:09.489870+0000","last_became_peered":"2024-08-17T02:29:09.489870+0000","last_unstale":"2024-08-17T02:29:09.492664+0000","last_undegraded":"2024-08-17T02:29:09.492664+0000","last_fullsized":"2024-08-17T02:29:09.492664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481752+0000","last_change":"2024-08-17T02:29:09.472840+0000","last_active":"2024-08-17T02:29:09.481752+0000","last_peered":"2024-08-17T02:29:09.481752+0000","last_clean":"2024-08-17T02:29:09.481752+0000","last_became_active":"2024-08-17T02:29:09.472553+0000","last_became_peered":"2024-08-17T02:29:09.472553+0000","last_unstale":"2024-08-17T02:29:09.481752+0000","last_undegraded":"2024-08-17T02:29:09.481752+0000","last_fullsized":"2024-08-17T02:29:09.481752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486135+0000","last_change":"2024-08-17T02:29:09.482798+0000","last_active":"2024-08-17T02:29:09.486135+0000","last_peered":"2024-08-17T02:29:09.486135+0000","last_clean":"2024-08-17T02:29:09.486135+0000","last_became_active":"2024-08-17T02:29:09.480991+0000","last_became_peered":"2024-08-17T02:29:09.480991+0000","last_unstale":"2024-08-17T02:29:09.486135+0000","last_undegraded":"2024-08-17T02:29:09.486135+0000","last_fullsized":"2024-08-17T02:29:09.486135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:54:55.005910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483656+0000","last_change":"2024-08-17T02:29:09.481066+0000","last_active":"2024-08-17T02:29:09.483656+0000","last_peered":"2024-08-17T02:29:09.483656+0000","last_clean":"2024-08-17T02:29:09.483656+0000","last_became_active":"2024-08-17T02:29:09.480760+0000","last_became_peered":"2024-08-17T02:29:09.480760+0000","last_unstale":"2024-08-17T02:29:09.483656+0000","last_undegraded":"2024-08-17T02:29:09.483656+0000","last_fullsized":"2024-08-17T02:29:09.483656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489725+0000","last_change":"2024-08-17T02:29:09.481328+0000","last_active":"2024-08-17T02:29:09.489725+0000","last_peered":"2024-08-17T02:29:09.489725+0000","last_clean":"2024-08-17T02:29:09.489725+0000","last_became_active":"2024-08-17T02:29:09.480207+0000","last_became_peered":"2024-08-17T02:29:09.480207+0000","last_unstale":"2024-08-17T02:29:09.489725+0000","last_undegraded":"2024-08-17T02:29:09.489725+0000","last_fullsized":"2024-08-17T02:29:09.489725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495304+0000","last_change":"2024-08-17T02:29:09.493921+0000","last_active":"2024-08-17T02:29:09.495304+0000","last_peered":"2024-08-17T02:29:09.495304+0000","last_clean":"2024-08-17T02:29:09.495304+0000","last_became_active":"2024-08-17T02:29:09.493466+0000","last_became_peered":"2024-08-17T02:29:09.493466+0000","last_unstale":"2024-08-17T02:29:09.495304+0000","last_undegraded":"2024-08-17T02:29:09.495304+0000","last_fullsized":"2024-08-17T02:29:09.495304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.486278+0000","last_change":"2024-08-17T02:29:09.473340+0000","last_active":"2024-08-17T02:29:09.486278+0000","last_peered":"2024-08-17T02:29:09.486278+0000","last_clean":"2024-08-17T02:29:09.486278+0000","last_became_active":"2024-08-17T02:29:09.473031+0000","last_became_peered":"2024-08-17T02:29:09.473031+0000","last_unstale":"2024-08-17T02:29:09.486278+0000","last_undegraded":"2024-08-17T02:29:09.486278+0000","last_fullsized":"2024-08-17T02:29:09.486278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473205+0000","last_change":"2024-08-17T02:29:09.469323+0000","last_active":"2024-08-17T02:29:09.473205+0000","last_peered":"2024-08-17T02:29:09.473205+0000","last_clean":"2024-08-17T02:29:09.473205+0000","last_became_active":"2024-08-17T02:29:09.468822+0000","last_became_peered":"2024-08-17T02:29:09.468822+0000","last_unstale":"2024-08-17T02:29:09.473205+0000","last_undegraded":"2024-08-17T02:29:09.473205+0000","last_fullsized":"2024-08-17T02:29:09.473205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.492646+0000","last_change":"2024-08-17T02:29:09.490137+0000","last_active":"2024-08-17T02:29:09.492646+0000","last_peered":"2024-08-17T02:29:09.492646+0000","last_clean":"2024-08-17T02:29:09.492646+0000","last_became_active":"2024-08-17T02:29:09.489622+0000","last_became_peered":"2024-08-17T02:29:09.489622+0000","last_unstale":"2024-08-17T02:29:09.492646+0000","last_undegraded":"2024-08-17T02:29:09.492646+0000","last_fullsized":"2024-08-17T02:29:09.492646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483236+0000","last_change":"2024-08-17T02:29:09.481874+0000","last_active":"2024-08-17T02:29:09.483236+0000","last_peered":"2024-08-17T02:29:09.483236+0000","last_clean":"2024-08-17T02:29:09.483236+0000","last_became_active":"2024-08-17T02:29:09.481627+0000","last_became_peered":"2024-08-17T02:29:09.481627+0000","last_unstale":"2024-08-17T02:29:09.483236+0000","last_undegraded":"2024-08-17T02:29:09.483236+0000","last_fullsized":"2024-08-17T02:29:09.483236+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:54.522995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487202+0000","last_change":"2024-08-17T02:29:09.475428+0000","last_active":"2024-08-17T02:29:09.487202+0000","last_peered":"2024-08-17T02:29:09.487202+0000","last_clean":"2024-08-17T02:29:09.487202+0000","last_became_active":"2024-08-17T02:29:09.474993+0000","last_became_peered":"2024-08-17T02:29:09.474993+0000","last_unstale":"2024-08-17T02:29:09.487202+0000","last_undegraded":"2024-08-17T02:29:09.487202+0000","last_fullsized":"2024-08-17T02:29:09.487202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484961+0000","last_change":"2024-08-17T02:29:09.478702+0000","last_active":"2024-08-17T02:29:09.484961+0000","last_peered":"2024-08-17T02:29:09.484961+0000","last_clean":"2024-08-17T02:29:09.484961+0000","last_became_active":"2024-08-17T02:29:09.478413+0000","last_became_peered":"2024-08-17T02:29:09.478413+0000","last_unstale":"2024-08-17T02:29:09.484961+0000","last_undegraded":"2024-08-17T02:29:09.484961+0000","last_fullsized":"2024-08-17T02:29:09.484961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:38:49.001606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504251+0000","last_change":"2024-08-17T02:29:08.470650+0000","last_active":"2024-08-17T02:29:09.504251+0000","last_peered":"2024-08-17T02:29:09.504251+0000","last_clean":"2024-08-17T02:29:09.504251+0000","last_became_active":"2024-08-17T02:29:08.470347+0000","last_became_peered":"2024-08-17T02:29:08.470347+0000","last_unstale":"2024-08-17T02:29:09.504251+0000","last_undegraded":"2024-08-17T02:29:09.504251+0000","last_fullsized":"2024-08-17T02:29:09.504251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477184+0000","last_change":"2024-08-17T02:29:09.472832+0000","last_active":"2024-08-17T02:29:09.477184+0000","last_peered":"2024-08-17T02:29:09.477184+0000","last_clean":"2024-08-17T02:29:09.477184+0000","last_became_active":"2024-08-17T02:29:09.472581+0000","last_became_peered":"2024-08-17T02:29:09.472581+0000","last_unstale":"2024-08-17T02:29:09.477184+0000","last_undegraded":"2024-08-17T02:29:09.477184+0000","last_fullsized":"2024-08-17T02:29:09.477184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501308+0000","last_change":"2024-08-17T02:29:08.460904+0000","last_active":"2024-08-17T02:29:09.501308+0000","last_peered":"2024-08-17T02:29:09.501308+0000","last_clean":"2024-08-17T02:29:09.501308+0000","last_became_active":"2024-08-17T02:29:08.458813+0000","last_became_peered":"2024-08-17T02:29:08.458813+0000","last_unstale":"2024-08-17T02:29:09.501308+0000","last_undegraded":"2024-08-17T02:29:09.501308+0000","last_fullsized":"2024-08-17T02:29:09.501308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.465640+0000","last_change":"2024-08-17T02:29:08.469946+0000","last_active":"2024-08-17T02:29:09.465640+0000","last_peered":"2024-08-17T02:29:09.465640+0000","last_clean":"2024-08-17T02:29:09.465640+0000","last_became_active":"2024-08-17T02:29:08.469719+0000","last_became_peered":"2024-08-17T02:29:08.469719+0000","last_unstale":"2024-08-17T02:29:09.465640+0000","last_undegraded":"2024-08-17T02:29:09.465640+0000","last_fullsized":"2024-08-17T02:29:09.465640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483357+0000","last_change":"2024-08-17T02:29:09.480169+0000","last_active":"2024-08-17T02:29:09.483357+0000","last_peered":"2024-08-17T02:29:09.483357+0000","last_clean":"2024-08-17T02:29:09.483357+0000","last_became_active":"2024-08-17T02:29:09.479899+0000","last_became_peered":"2024-08-17T02:29:09.479899+0000","last_unstale":"2024-08-17T02:29:09.483357+0000","last_undegraded":"2024-08-17T02:29:09.483357+0000","last_fullsized":"2024-08-17T02:29:09.483357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:35.650848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468522+0000","last_change":"2024-08-17T02:29:08.463843+0000","last_active":"2024-08-17T02:29:09.468522+0000","last_peered":"2024-08-17T02:29:09.468522+0000","last_clean":"2024-08-17T02:29:09.468522+0000","last_became_active":"2024-08-17T02:29:08.463583+0000","last_became_peered":"2024-08-17T02:29:08.463583+0000","last_unstale":"2024-08-17T02:29:09.468522+0000","last_undegraded":"2024-08-17T02:29:09.468522+0000","last_fullsized":"2024-08-17T02:29:09.468522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488064+0000","last_change":"2024-08-17T02:29:09.485700+0000","last_active":"2024-08-17T02:29:09.488064+0000","last_peered":"2024-08-17T02:29:09.488064+0000","last_clean":"2024-08-17T02:29:09.488064+0000","last_became_active":"2024-08-17T02:29:09.485419+0000","last_became_peered":"2024-08-17T02:29:09.485419+0000","last_unstale":"2024-08-17T02:29:09.488064+0000","last_undegraded":"2024-08-17T02:29:09.488064+0000","last_fullsized":"2024-08-17T02:29:09.488064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470817+0000","last_change":"2024-08-17T02:29:08.476092+0000","last_active":"2024-08-17T02:29:09.470817+0000","last_peered":"2024-08-17T02:29:09.470817+0000","last_clean":"2024-08-17T02:29:09.470817+0000","last_became_active":"2024-08-17T02:29:08.475723+0000","last_became_peered":"2024-08-17T02:29:08.475723+0000","last_unstale":"2024-08-17T02:29:09.470817+0000","last_undegraded":"2024-08-17T02:29:09.470817+0000","last_fullsized":"2024-08-17T02:29:09.470817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484090+0000","last_change":"2024-08-17T02:29:09.481568+0000","last_active":"2024-08-17T02:29:09.484090+0000","last_peered":"2024-08-17T02:29:09.484090+0000","last_clean":"2024-08-17T02:29:09.484090+0000","last_became_active":"2024-08-17T02:29:09.481252+0000","last_became_peered":"2024-08-17T02:29:09.481252+0000","last_unstale":"2024-08-17T02:29:09.484090+0000","last_undegraded":"2024-08-17T02:29:09.484090+0000","last_fullsized":"2024-08-17T02:29:09.484090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:25.505828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.468015+0000","last_change":"2024-08-17T02:29:08.477837+0000","last_active":"2024-08-17T02:29:09.468015+0000","last_peered":"2024-08-17T02:29:09.468015+0000","last_clean":"2024-08-17T02:29:09.468015+0000","last_became_active":"2024-08-17T02:29:08.477381+0000","last_became_peered":"2024-08-17T02:29:08.477381+0000","last_unstale":"2024-08-17T02:29:09.468015+0000","last_undegraded":"2024-08-17T02:29:09.468015+0000","last_fullsized":"2024-08-17T02:29:09.468015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494137+0000","last_change":"2024-08-17T02:29:09.490274+0000","last_active":"2024-08-17T02:29:09.494137+0000","last_peered":"2024-08-17T02:29:09.494137+0000","last_clean":"2024-08-17T02:29:09.494137+0000","last_became_active":"2024-08-17T02:29:09.489910+0000","last_became_peered":"2024-08-17T02:29:09.489910+0000","last_unstale":"2024-08-17T02:29:09.494137+0000","last_undegraded":"2024-08-17T02:29:09.494137+0000","last_fullsized":"2024-08-17T02:29:09.494137+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.495817+0000","last_change":"2024-08-17T02:29:08.470400+0000","last_active":"2024-08-17T02:29:09.495817+0000","last_peered":"2024-08-17T02:29:09.495817+0000","last_clean":"2024-08-17T02:29:09.495817+0000","last_became_active":"2024-08-17T02:29:08.470132+0000","last_became_peered":"2024-08-17T02:29:08.470132+0000","last_unstale":"2024-08-17T02:29:09.495817+0000","last_undegraded":"2024-08-17T02:29:09.495817+0000","last_fullsized":"2024-08-17T02:29:09.495817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483484+0000","last_change":"2024-08-17T02:29:09.476627+0000","last_active":"2024-08-17T02:29:09.483484+0000","last_peered":"2024-08-17T02:29:09.483484+0000","last_clean":"2024-08-17T02:29:09.483484+0000","last_became_active":"2024-08-17T02:29:09.475796+0000","last_became_peered":"2024-08-17T02:29:09.475796+0000","last_unstale":"2024-08-17T02:29:09.483484+0000","last_undegraded":"2024-08-17T02:29:09.483484+0000","last_fullsized":"2024-08-17T02:29:09.483484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.793675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.506084+0000","last_change":"2024-08-17T02:29:08.476918+0000","last_active":"2024-08-17T02:29:09.506084+0000","last_peered":"2024-08-17T02:29:09.506084+0000","last_clean":"2024-08-17T02:29:09.506084+0000","last_became_active":"2024-08-17T02:29:08.476398+0000","last_became_peered":"2024-08-17T02:29:08.476398+0000","last_unstale":"2024-08-17T02:29:09.506084+0000","last_undegraded":"2024-08-17T02:29:09.506084+0000","last_fullsized":"2024-08-17T02:29:09.506084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503892+0000","last_change":"2024-08-17T02:29:09.502218+0000","last_active":"2024-08-17T02:29:09.503892+0000","last_peered":"2024-08-17T02:29:09.503892+0000","last_clean":"2024-08-17T02:29:09.503892+0000","last_became_active":"2024-08-17T02:29:09.495867+0000","last_became_peered":"2024-08-17T02:29:09.495867+0000","last_unstale":"2024-08-17T02:29:09.503892+0000","last_undegraded":"2024-08-17T02:29:09.503892+0000","last_fullsized":"2024-08-17T02:29:09.503892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:02:42.929201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.500523+0000","last_change":"2024-08-17T02:29:08.456255+0000","last_active":"2024-08-17T02:29:09.500523+0000","last_peered":"2024-08-17T02:29:09.500523+0000","last_clean":"2024-08-17T02:29:09.500523+0000","last_became_active":"2024-08-17T02:29:08.455951+0000","last_became_peered":"2024-08-17T02:29:08.455951+0000","last_unstale":"2024-08-17T02:29:09.500523+0000","last_undegraded":"2024-08-17T02:29:09.500523+0000","last_fullsized":"2024-08-17T02:29:09.500523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494299+0000","last_change":"2024-08-17T02:29:09.491084+0000","last_active":"2024-08-17T02:29:09.494299+0000","last_peered":"2024-08-17T02:29:09.494299+0000","last_clean":"2024-08-17T02:29:09.494299+0000","last_became_active":"2024-08-17T02:29:09.486223+0000","last_became_peered":"2024-08-17T02:29:09.486223+0000","last_unstale":"2024-08-17T02:29:09.494299+0000","last_undegraded":"2024-08-17T02:29:09.494299+0000","last_fullsized":"2024-08-17T02:29:09.494299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488081+0000","last_change":"2024-08-17T02:29:08.472582+0000","last_active":"2024-08-17T02:29:09.488081+0000","last_peered":"2024-08-17T02:29:09.488081+0000","last_clean":"2024-08-17T02:29:09.488081+0000","last_became_active":"2024-08-17T02:29:08.472353+0000","last_became_peered":"2024-08-17T02:29:08.472353+0000","last_unstale":"2024-08-17T02:29:09.488081+0000","last_undegraded":"2024-08-17T02:29:09.488081+0000","last_fullsized":"2024-08-17T02:29:09.488081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503846+0000","last_change":"2024-08-17T02:29:09.492684+0000","last_active":"2024-08-17T02:29:09.503846+0000","last_peered":"2024-08-17T02:29:09.503846+0000","last_clean":"2024-08-17T02:29:09.503846+0000","last_became_active":"2024-08-17T02:29:09.492444+0000","last_became_peered":"2024-08-17T02:29:09.492444+0000","last_unstale":"2024-08-17T02:29:09.503846+0000","last_undegraded":"2024-08-17T02:29:09.503846+0000","last_fullsized":"2024-08-17T02:29:09.503846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.470244+0000","last_change":"2024-08-17T02:29:08.475729+0000","last_active":"2024-08-17T02:29:09.470244+0000","last_peered":"2024-08-17T02:29:09.470244+0000","last_clean":"2024-08-17T02:29:09.470244+0000","last_became_active":"2024-08-17T02:29:08.475476+0000","last_became_peered":"2024-08-17T02:29:08.475476+0000","last_unstale":"2024-08-17T02:29:09.470244+0000","last_undegraded":"2024-08-17T02:29:09.470244+0000","last_fullsized":"2024-08-17T02:29:09.470244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.487181+0000","last_change":"2024-08-17T02:29:09.475265+0000","last_active":"2024-08-17T02:29:09.487181+0000","last_peered":"2024-08-17T02:29:09.487181+0000","last_clean":"2024-08-17T02:29:09.487181+0000","last_became_active":"2024-08-17T02:29:09.474621+0000","last_became_peered":"2024-08-17T02:29:09.474621+0000","last_unstale":"2024-08-17T02:29:09.487181+0000","last_undegraded":"2024-08-17T02:29:09.487181+0000","last_fullsized":"2024-08-17T02:29:09.487181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496446+0000","last_change":"2024-08-17T02:29:08.461859+0000","last_active":"2024-08-17T02:29:09.496446+0000","last_peered":"2024-08-17T02:29:09.496446+0000","last_clean":"2024-08-17T02:29:09.496446+0000","last_became_active":"2024-08-17T02:29:08.461535+0000","last_became_peered":"2024-08-17T02:29:08.461535+0000","last_unstale":"2024-08-17T02:29:09.496446+0000","last_undegraded":"2024-08-17T02:29:09.496446+0000","last_fullsized":"2024-08-17T02:29:09.496446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:29.402742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501548+0000","last_change":"2024-08-17T02:29:09.491129+0000","last_active":"2024-08-17T02:29:09.501548+0000","last_peered":"2024-08-17T02:29:09.501548+0000","last_clean":"2024-08-17T02:29:09.501548+0000","last_became_active":"2024-08-17T02:29:09.490847+0000","last_became_peered":"2024-08-17T02:29:09.490847+0000","last_unstale":"2024-08-17T02:29:09.501548+0000","last_undegraded":"2024-08-17T02:29:09.501548+0000","last_fullsized":"2024-08-17T02:29:09.501548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:08.684679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496485+0000","last_change":"2024-08-17T02:29:08.457588+0000","last_active":"2024-08-17T02:29:09.496485+0000","last_peered":"2024-08-17T02:29:09.496485+0000","last_clean":"2024-08-17T02:29:09.496485+0000","last_became_active":"2024-08-17T02:29:08.457346+0000","last_became_peered":"2024-08-17T02:29:08.457346+0000","last_unstale":"2024-08-17T02:29:09.496485+0000","last_undegraded":"2024-08-17T02:29:09.496485+0000","last_fullsized":"2024-08-17T02:29:09.496485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:59:08.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502379+0000","last_change":"2024-08-17T02:29:09.494028+0000","last_active":"2024-08-17T02:29:09.502379+0000","last_peered":"2024-08-17T02:29:09.502379+0000","last_clean":"2024-08-17T02:29:09.502379+0000","last_became_active":"2024-08-17T02:29:09.493737+0000","last_became_peered":"2024-08-17T02:29:09.493737+0000","last_unstale":"2024-08-17T02:29:09.502379+0000","last_undegraded":"2024-08-17T02:29:09.502379+0000","last_fullsized":"2024-08-17T02:29:09.502379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.491687+0000","last_change":"2024-08-17T02:29:08.466598+0000","last_active":"2024-08-17T02:29:09.491687+0000","last_peered":"2024-08-17T02:29:09.491687+0000","last_clean":"2024-08-17T02:29:09.491687+0000","last_became_active":"2024-08-17T02:29:08.466312+0000","last_became_peered":"2024-08-17T02:29:08.466312+0000","last_unstale":"2024-08-17T02:29:09.491687+0000","last_undegraded":"2024-08-17T02:29:09.491687+0000","last_fullsized":"2024-08-17T02:29:09.491687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:32:20.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504407+0000","last_change":"2024-08-17T02:29:09.503142+0000","last_active":"2024-08-17T02:29:09.504407+0000","last_peered":"2024-08-17T02:29:09.504407+0000","last_clean":"2024-08-17T02:29:09.504407+0000","last_became_active":"2024-08-17T02:29:09.500631+0000","last_became_peered":"2024-08-17T02:29:09.500631+0000","last_unstale":"2024-08-17T02:29:09.504407+0000","last_undegraded":"2024-08-17T02:29:09.504407+0000","last_fullsized":"2024-08-17T02:29:09.504407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.496744+0000","last_change":"2024-08-17T02:29:08.461264+0000","last_active":"2024-08-17T02:29:09.496744+0000","last_peered":"2024-08-17T02:29:09.496744+0000","last_clean":"2024-08-17T02:29:09.496744+0000","last_became_active":"2024-08-17T02:29:08.460980+0000","last_became_peered":"2024-08-17T02:29:08.460980+0000","last_unstale":"2024-08-17T02:29:09.496744+0000","last_undegraded":"2024-08-17T02:29:09.496744+0000","last_fullsized":"2024-08-17T02:29:09.496744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494761+0000","last_change":"2024-08-17T02:29:09.491641+0000","last_active":"2024-08-17T02:29:09.494761+0000","last_peered":"2024-08-17T02:29:09.494761+0000","last_clean":"2024-08-17T02:29:09.494761+0000","last_became_active":"2024-08-17T02:29:09.491430+0000","last_became_peered":"2024-08-17T02:29:09.491430+0000","last_unstale":"2024-08-17T02:29:09.494761+0000","last_undegraded":"2024-08-17T02:29:09.494761+0000","last_fullsized":"2024-08-17T02:29:09.494761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.363227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466879+0000","last_change":"2024-08-17T02:29:08.471744+0000","last_active":"2024-08-17T02:29:09.466879+0000","last_peered":"2024-08-17T02:29:09.466879+0000","last_clean":"2024-08-17T02:29:09.466879+0000","last_became_active":"2024-08-17T02:29:08.471449+0000","last_became_peered":"2024-08-17T02:29:08.471449+0000","last_unstale":"2024-08-17T02:29:09.466879+0000","last_undegraded":"2024-08-17T02:29:09.466879+0000","last_fullsized":"2024-08-17T02:29:09.466879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:35:08.003509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504380+0000","last_change":"2024-08-17T02:29:09.502714+0000","last_active":"2024-08-17T02:29:09.504380+0000","last_peered":"2024-08-17T02:29:09.504380+0000","last_clean":"2024-08-17T02:29:09.504380+0000","last_became_active":"2024-08-17T02:29:09.502509+0000","last_became_peered":"2024-08-17T02:29:09.502509+0000","last_unstale":"2024-08-17T02:29:09.504380+0000","last_undegraded":"2024-08-17T02:29:09.504380+0000","last_fullsized":"2024-08-17T02:29:09.504380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:51:11.241240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475314+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:09.475314+0000","last_peered":"2024-08-17T02:29:09.475314+0000","last_clean":"2024-08-17T02:29:09.475314+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:09.475314+0000","last_undegraded":"2024-08-17T02:29:09.475314+0000","last_fullsized":"2024-08-17T02:29:09.475314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472401+0000","last_change":"2024-08-17T02:29:08.460254+0000","last_active":"2024-08-17T02:29:09.472401+0000","last_peered":"2024-08-17T02:29:09.472401+0000","last_clean":"2024-08-17T02:29:09.472401+0000","last_became_active":"2024-08-17T02:29:08.459985+0000","last_became_peered":"2024-08-17T02:29:08.459985+0000","last_unstale":"2024-08-17T02:29:09.472401+0000","last_undegraded":"2024-08-17T02:29:09.472401+0000","last_fullsized":"2024-08-17T02:29:09.472401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499667+0000","last_change":"2024-08-17T02:29:09.498589+0000","last_active":"2024-08-17T02:29:09.499667+0000","last_peered":"2024-08-17T02:29:09.499667+0000","last_clean":"2024-08-17T02:29:09.499667+0000","last_became_active":"2024-08-17T02:29:09.498056+0000","last_became_peered":"2024-08-17T02:29:09.498056+0000","last_unstale":"2024-08-17T02:29:09.499667+0000","last_undegraded":"2024-08-17T02:29:09.499667+0000","last_fullsized":"2024-08-17T02:29:09.499667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475226+0000","last_change":"2024-08-17T02:29:08.470766+0000","last_active":"2024-08-17T02:29:09.475226+0000","last_peered":"2024-08-17T02:29:09.475226+0000","last_clean":"2024-08-17T02:29:09.475226+0000","last_became_active":"2024-08-17T02:29:08.470301+0000","last_became_peered":"2024-08-17T02:29:08.470301+0000","last_unstale":"2024-08-17T02:29:09.475226+0000","last_undegraded":"2024-08-17T02:29:09.475226+0000","last_fullsized":"2024-08-17T02:29:09.475226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:29:53.521134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.472473+0000","last_change":"2024-08-17T02:29:09.465345+0000","last_active":"2024-08-17T02:29:09.472473+0000","last_peered":"2024-08-17T02:29:09.472473+0000","last_clean":"2024-08-17T02:29:09.472473+0000","last_became_active":"2024-08-17T02:29:09.465075+0000","last_became_peered":"2024-08-17T02:29:09.465075+0000","last_unstale":"2024-08-17T02:29:09.472473+0000","last_undegraded":"2024-08-17T02:29:09.472473+0000","last_fullsized":"2024-08-17T02:29:09.472473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:07:16.574426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.466876+0000","last_change":"2024-08-17T02:29:08.473928+0000","last_active":"2024-08-17T02:29:09.466876+0000","last_peered":"2024-08-17T02:29:09.466876+0000","last_clean":"2024-08-17T02:29:09.466876+0000","last_became_active":"2024-08-17T02:29:08.473189+0000","last_became_peered":"2024-08-17T02:29:08.473189+0000","last_unstale":"2024-08-17T02:29:09.466876+0000","last_undegraded":"2024-08-17T02:29:09.466876+0000","last_fullsized":"2024-08-17T02:29:09.466876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.479531+0000","last_change":"2024-08-17T02:29:09.477076+0000","last_active":"2024-08-17T02:29:09.479531+0000","last_peered":"2024-08-17T02:29:09.479531+0000","last_clean":"2024-08-17T02:29:09.479531+0000","last_became_active":"2024-08-17T02:29:09.476789+0000","last_became_peered":"2024-08-17T02:29:09.476789+0000","last_unstale":"2024-08-17T02:29:09.479531+0000","last_undegraded":"2024-08-17T02:29:09.479531+0000","last_fullsized":"2024-08-17T02:29:09.479531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.488186+0000","last_change":"2024-08-17T02:29:08.472166+0000","last_active":"2024-08-17T02:29:09.488186+0000","last_peered":"2024-08-17T02:29:09.488186+0000","last_clean":"2024-08-17T02:29:09.488186+0000","last_became_active":"2024-08-17T02:29:08.471933+0000","last_became_peered":"2024-08-17T02:29:08.471933+0000","last_unstale":"2024-08-17T02:29:09.488186+0000","last_undegraded":"2024-08-17T02:29:09.488186+0000","last_fullsized":"2024-08-17T02:29:09.488186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484642+0000","last_change":"2024-08-17T02:29:09.478904+0000","last_active":"2024-08-17T02:29:09.484642+0000","last_peered":"2024-08-17T02:29:09.484642+0000","last_clean":"2024-08-17T02:29:09.484642+0000","last_became_active":"2024-08-17T02:29:09.476164+0000","last_became_peered":"2024-08-17T02:29:09.476164+0000","last_unstale":"2024-08-17T02:29:09.484642+0000","last_undegraded":"2024-08-17T02:29:09.484642+0000","last_fullsized":"2024-08-17T02:29:09.484642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:29:06.838621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.474425+0000","last_change":"2024-08-17T02:29:08.461319+0000","last_active":"2024-08-17T02:29:09.474425+0000","last_peered":"2024-08-17T02:29:09.474425+0000","last_clean":"2024-08-17T02:29:09.474425+0000","last_became_active":"2024-08-17T02:29:08.460994+0000","last_became_peered":"2024-08-17T02:29:08.460994+0000","last_unstale":"2024-08-17T02:29:09.474425+0000","last_undegraded":"2024-08-17T02:29:09.474425+0000","last_fullsized":"2024-08-17T02:29:09.474425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.501176+0000","last_change":"2024-08-17T02:29:09.498026+0000","last_active":"2024-08-17T02:29:09.501176+0000","last_peered":"2024-08-17T02:29:09.501176+0000","last_clean":"2024-08-17T02:29:09.501176+0000","last_became_active":"2024-08-17T02:29:09.497741+0000","last_became_peered":"2024-08-17T02:29:09.497741+0000","last_unstale":"2024-08-17T02:29:09.501176+0000","last_undegraded":"2024-08-17T02:29:09.501176+0000","last_fullsized":"2024-08-17T02:29:09.501176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:28:02.020058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.484472+0000","last_change":"2024-08-17T02:29:08.471249+0000","last_active":"2024-08-17T02:29:09.484472+0000","last_peered":"2024-08-17T02:29:09.484472+0000","last_clean":"2024-08-17T02:29:09.484472+0000","last_became_active":"2024-08-17T02:29:08.470658+0000","last_became_peered":"2024-08-17T02:29:08.470658+0000","last_unstale":"2024-08-17T02:29:09.484472+0000","last_undegraded":"2024-08-17T02:29:09.484472+0000","last_fullsized":"2024-08-17T02:29:09.484472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:45:56.805340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.477525+0000","last_change":"2024-08-17T02:29:09.475433+0000","last_active":"2024-08-17T02:29:09.477525+0000","last_peered":"2024-08-17T02:29:09.477525+0000","last_clean":"2024-08-17T02:29:09.477525+0000","last_became_active":"2024-08-17T02:29:09.475166+0000","last_became_peered":"2024-08-17T02:29:09.475166+0000","last_unstale":"2024-08-17T02:29:09.477525+0000","last_undegraded":"2024-08-17T02:29:09.477525+0000","last_fullsized":"2024-08-17T02:29:09.477525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-08-17T02:29:10.474088+0000","last_change":"2024-08-17T02:29:08.473436+0000","last_active":"2024-08-17T02:29:10.474088+0000","last_peered":"2024-08-17T02:29:10.474088+0000","last_clean":"2024-08-17T02:29:10.474088+0000","last_became_active":"2024-08-17T02:29:08.473221+0000","last_became_peered":"2024-08-17T02:29:08.473221+0000","last_unstale":"2024-08-17T02:29:10.474088+0000","last_undegraded":"2024-08-17T02:29:10.474088+0000","last_fullsized":"2024-08-17T02:29:10.474088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483637+0000","last_change":"2024-08-17T02:29:09.480720+0000","last_active":"2024-08-17T02:29:09.483637+0000","last_peered":"2024-08-17T02:29:09.483637+0000","last_clean":"2024-08-17T02:29:09.483637+0000","last_became_active":"2024-08-17T02:29:09.480335+0000","last_became_peered":"2024-08-17T02:29:09.480335+0000","last_unstale":"2024-08-17T02:29:09.483637+0000","last_undegraded":"2024-08-17T02:29:09.483637+0000","last_fullsized":"2024-08-17T02:29:09.483637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:04.337067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.504904+0000","last_change":"2024-08-17T02:29:08.473608+0000","last_active":"2024-08-17T02:29:09.504904+0000","last_peered":"2024-08-17T02:29:09.504904+0000","last_clean":"2024-08-17T02:29:09.504904+0000","last_became_active":"2024-08-17T02:29:08.473188+0000","last_became_peered":"2024-08-17T02:29:08.473188+0000","last_unstale":"2024-08-17T02:29:09.504904+0000","last_undegraded":"2024-08-17T02:29:09.504904+0000","last_fullsized":"2024-08-17T02:29:09.504904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:00:09.294099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494131+0000","last_change":"2024-08-17T02:29:09.488891+0000","last_active":"2024-08-17T02:29:09.494131+0000","last_peered":"2024-08-17T02:29:09.494131+0000","last_clean":"2024-08-17T02:29:09.494131+0000","last_became_active":"2024-08-17T02:29:09.486565+0000","last_became_peered":"2024-08-17T02:29:09.486565+0000","last_unstale":"2024-08-17T02:29:09.494131+0000","last_undegraded":"2024-08-17T02:29:09.494131+0000","last_fullsized":"2024-08-17T02:29:09.494131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:46.073115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.475125+0000","last_change":"2024-08-17T02:29:08.470705+0000","last_active":"2024-08-17T02:29:09.475125+0000","last_peered":"2024-08-17T02:29:09.475125+0000","last_clean":"2024-08-17T02:29:09.475125+0000","last_became_active":"2024-08-17T02:29:08.469956+0000","last_became_peered":"2024-08-17T02:29:08.469956+0000","last_unstale":"2024-08-17T02:29:09.475125+0000","last_undegraded":"2024-08-17T02:29:09.475125+0000","last_fullsized":"2024-08-17T02:29:09.475125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.481784+0000","last_change":"2024-08-17T02:29:09.473933+0000","last_active":"2024-08-17T02:29:09.481784+0000","last_peered":"2024-08-17T02:29:09.481784+0000","last_clean":"2024-08-17T02:29:09.481784+0000","last_became_active":"2024-08-17T02:29:09.473044+0000","last_became_peered":"2024-08-17T02:29:09.473044+0000","last_unstale":"2024-08-17T02:29:09.481784+0000","last_undegraded":"2024-08-17T02:29:09.481784+0000","last_fullsized":"2024-08-17T02:29:09.481784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:34:17.880794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473548+0000","last_change":"2024-08-17T02:29:08.470009+0000","last_active":"2024-08-17T02:29:09.473548+0000","last_peered":"2024-08-17T02:29:09.473548+0000","last_clean":"2024-08-17T02:29:09.473548+0000","last_became_active":"2024-08-17T02:29:08.469646+0000","last_became_peered":"2024-08-17T02:29:08.469646+0000","last_unstale":"2024-08-17T02:29:09.473548+0000","last_undegraded":"2024-08-17T02:29:09.473548+0000","last_fullsized":"2024-08-17T02:29:09.473548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:37:25.482370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483992+0000","last_change":"2024-08-17T02:29:09.481399+0000","last_active":"2024-08-17T02:29:09.483992+0000","last_peered":"2024-08-17T02:29:09.483992+0000","last_clean":"2024-08-17T02:29:09.483992+0000","last_became_active":"2024-08-17T02:29:09.481104+0000","last_became_peered":"2024-08-17T02:29:09.481104+0000","last_unstale":"2024-08-17T02:29:09.483992+0000","last_undegraded":"2024-08-17T02:29:09.483992+0000","last_fullsized":"2024-08-17T02:29:09.483992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:38:25.941386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.473744+0000","last_change":"2024-08-17T02:29:08.468611+0000","last_active":"2024-08-17T02:29:09.473744+0000","last_peered":"2024-08-17T02:29:09.473744+0000","last_clean":"2024-08-17T02:29:09.473744+0000","last_became_active":"2024-08-17T02:29:08.468075+0000","last_became_peered":"2024-08-17T02:29:08.468075+0000","last_unstale":"2024-08-17T02:29:09.473744+0000","last_undegraded":"2024-08-17T02:29:09.473744+0000","last_fullsized":"2024-08-17T02:29:09.473744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.483055+0000","last_change":"2024-08-17T02:29:09.474989+0000","last_active":"2024-08-17T02:29:09.483055+0000","last_peered":"2024-08-17T02:29:09.483055+0000","last_clean":"2024-08-17T02:29:09.483055+0000","last_became_active":"2024-08-17T02:29:09.474717+0000","last_became_peered":"2024-08-17T02:29:09.474717+0000","last_unstale":"2024-08-17T02:29:09.483055+0000","last_undegraded":"2024-08-17T02:29:09.483055+0000","last_fullsized":"2024-08-17T02:29:09.483055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:47:43.508785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494182+0000","last_change":"2024-08-17T02:29:08.474152+0000","last_active":"2024-08-17T02:29:09.494182+0000","last_peered":"2024-08-17T02:29:09.494182+0000","last_clean":"2024-08-17T02:29:09.494182+0000","last_became_active":"2024-08-17T02:29:08.473850+0000","last_became_peered":"2024-08-17T02:29:08.473850+0000","last_unstale":"2024-08-17T02:29:09.494182+0000","last_undegraded":"2024-08-17T02:29:09.494182+0000","last_fullsized":"2024-08-17T02:29:09.494182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:23.198789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489628+0000","last_change":"2024-08-17T02:29:09.480093+0000","last_active":"2024-08-17T02:29:09.489628+0000","last_peered":"2024-08-17T02:29:09.489628+0000","last_clean":"2024-08-17T02:29:09.489628+0000","last_became_active":"2024-08-17T02:29:09.472172+0000","last_became_peered":"2024-08-17T02:29:09.472172+0000","last_unstale":"2024-08-17T02:29:09.489628+0000","last_undegraded":"2024-08-17T02:29:09.489628+0000","last_fullsized":"2024-08-17T02:29:09.489628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:58:19.174663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.499201+0000","last_change":"2024-08-17T02:29:09.494902+0000","last_active":"2024-08-17T02:29:09.499201+0000","last_peered":"2024-08-17T02:29:09.499201+0000","last_clean":"2024-08-17T02:29:09.499201+0000","last_became_active":"2024-08-17T02:29:09.491782+0000","last_became_peered":"2024-08-17T02:29:09.491782+0000","last_unstale":"2024-08-17T02:29:09.499201+0000","last_undegraded":"2024-08-17T02:29:09.499201+0000","last_fullsized":"2024-08-17T02:29:09.499201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:59.378342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502069+0000","last_change":"2024-08-17T02:29:08.475348+0000","last_active":"2024-08-17T02:29:09.502069+0000","last_peered":"2024-08-17T02:29:09.502069+0000","last_clean":"2024-08-17T02:29:09.502069+0000","last_became_active":"2024-08-17T02:29:08.475111+0000","last_became_peered":"2024-08-17T02:29:08.475111+0000","last_unstale":"2024-08-17T02:29:09.502069+0000","last_undegraded":"2024-08-17T02:29:09.502069+0000","last_fullsized":"2024-08-17T02:29:09.502069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:21:10.249183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.497333+0000","last_change":"2024-08-17T02:29:09.492777+0000","last_active":"2024-08-17T02:29:09.497333+0000","last_peered":"2024-08-17T02:29:09.497333+0000","last_clean":"2024-08-17T02:29:09.497333+0000","last_became_active":"2024-08-17T02:29:09.492531+0000","last_became_peered":"2024-08-17T02:29:09.492531+0000","last_unstale":"2024-08-17T02:29:09.497333+0000","last_undegraded":"2024-08-17T02:29:09.497333+0000","last_fullsized":"2024-08-17T02:29:09.497333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:58:27.693520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.502308+0000","last_change":"2024-08-17T02:29:08.473691+0000","last_active":"2024-08-17T02:29:09.502308+0000","last_peered":"2024-08-17T02:29:09.502308+0000","last_clean":"2024-08-17T02:29:09.502308+0000","last_became_active":"2024-08-17T02:29:08.473411+0000","last_became_peered":"2024-08-17T02:29:08.473411+0000","last_unstale":"2024-08-17T02:29:09.502308+0000","last_undegraded":"2024-08-17T02:29:09.502308+0000","last_fullsized":"2024-08-17T02:29:09.502308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:15.983391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494186+0000","last_change":"2024-08-17T02:29:09.492743+0000","last_active":"2024-08-17T02:29:09.494186+0000","last_peered":"2024-08-17T02:29:09.494186+0000","last_clean":"2024-08-17T02:29:09.494186+0000","last_became_active":"2024-08-17T02:29:09.492489+0000","last_became_peered":"2024-08-17T02:29:09.492489+0000","last_unstale":"2024-08-17T02:29:09.494186+0000","last_undegraded":"2024-08-17T02:29:09.494186+0000","last_fullsized":"2024-08-17T02:29:09.494186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:31:14.768302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.494368+0000","last_change":"2024-08-17T02:29:08.462205+0000","last_active":"2024-08-17T02:29:09.494368+0000","last_peered":"2024-08-17T02:29:09.494368+0000","last_clean":"2024-08-17T02:29:09.494368+0000","last_became_active":"2024-08-17T02:29:08.461965+0000","last_became_peered":"2024-08-17T02:29:08.461965+0000","last_unstale":"2024-08-17T02:29:09.494368+0000","last_undegraded":"2024-08-17T02:29:09.494368+0000","last_fullsized":"2024-08-17T02:29:09.494368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:14:12.450225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.489475+0000","last_change":"2024-08-17T02:29:09.481257+0000","last_active":"2024-08-17T02:29:09.489475+0000","last_peered":"2024-08-17T02:29:09.489475+0000","last_clean":"2024-08-17T02:29:09.489475+0000","last_became_active":"2024-08-17T02:29:09.480977+0000","last_became_peered":"2024-08-17T02:29:09.480977+0000","last_unstale":"2024-08-17T02:29:09.489475+0000","last_undegraded":"2024-08-17T02:29:09.489475+0000","last_fullsized":"2024-08-17T02:29:09.489475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:08.439377+0000","last_clean_scrub_stamp":"2024-08-17T02:29:08.439377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:07.592166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-08-17T02:29:09.503649+0000","last_change":"2024-08-17T02:29:08.459843+0000","last_active":"2024-08-17T02:29:09.503649+0000","last_peered":"2024-08-17T02:29:09.503649+0000","last_clean":"2024-08-17T02:29:09.503649+0000","last_became_active":"2024-08-17T02:29:08.459311+0000","last_became_peered":"2024-08-17T02:29:08.459311+0000","last_unstale":"2024-08-17T02:29:09.503649+0000","last_undegraded":"2024-08-17T02:29:09.503649+0000","last_fullsized":"2024-08-17T02:29:09.503649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:07.437515+0000","last_clean_scrub_stamp":"2024-08-17T02:29:07.437515+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:14.102117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298160,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073680,"statfs":{"total":96636764160,"available":96331448320,"internally_reserved":0,"allocated":823296,"data_stored":669534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.45}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297584,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074256,"statfs":{"total":96636764160,"available":96332038144,"internally_reserved":0,"allocated":229376,"data_stored":78686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297588,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074252,"statfs":{"total":96636764160,"available":96332034048,"internally_reserved":0,"allocated":237568,"data_stored":78722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8170000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7490000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301752,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070088,"statfs":{"total":96636764160,"available":96327770112,"internally_reserved":0,"allocated":237568,"data_stored":80148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301740,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070100,"statfs":{"total":96636764160,"available":96327782400,"internally_reserved":0,"allocated":225280,"data_stored":78596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":233472,"data_stored":78756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":831488,"data_stored":669590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:18.958 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:29:18.958 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:29:18.958 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:29:18.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:29:19.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.138+0000 7f0444000640 1 Processor -- start 2024-08-17T02:29:19.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.138+0000 7f0444000640 1 -- start start 2024-08-17T02:29:19.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.139+0000 7f0444000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 0x7f043c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0444000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f043c06e080 0x7f043c06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0444000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0afc10 con 0x7f043c155550 2024-08-17T02:29:19.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0444000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c06ea20 con 0x7f043c06e080 2024-08-17T02:29:19.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0444000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0af000 con 0x7f043c155180 2024-08-17T02:29:19.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0440c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f043c155550 0x7f043c0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41404/0 (socket says 172.21.15.110:41404) 2024-08-17T02:29:19.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0440c00640 1 -- 172.21.15.110:0/94431001 learned_addr learned my addr 172.21.15.110:0/94431001 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:19.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0442000640 1 --2- 172.21.15.110:0/94431001 >> v2:172.21.15.177:3300/0 conn(0x7f043c06e080 0x7f043c06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0441600640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 0x7f043c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f043be00640 1 -- 172.21.15.110:0/94431001 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038805758 0 0) 0x7f043c0afc10 con 0x7f043c155550 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f043be00640 1 -- 172.21.15.110:0/94431001 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04240034e0 con 0x7f043c155550 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0442000640 1 -- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 msgr2=0x7f043c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0442000640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 0x7f043c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.140+0000 7f0442000640 1 -- 172.21.15.110:0/94431001 >> v1:172.21.15.110:6789/0 conn(0x7f043c155550 legacy=0x7f043c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.141+0000 7f0442000640 1 -- 172.21.15.110:0/94431001 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0af2e0 con 0x7f043c06e080 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.141+0000 7f0441600640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 0x7f043c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:19.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f0442000640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c06e080 0x7f043c06e4e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e60 tx=0x7f0434009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68fabef7a8358df8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f043be00640 1 -- 172.21.15.110:0/94431001 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434007550 con 0x7f043c06e080 2024-08-17T02:29:19.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f043be00640 1 -- 172.21.15.110:0/94431001 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043402d050 con 0x7f043c06e080 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f043be00640 1 -- 172.21.15.110:0/94431001 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434007920 con 0x7f043c06e080 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f0444000640 1 -- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c06e080 msgr2=0x7f043c06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.142+0000 7f0444000640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c06e080 0x7f043c06e4e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0434009e60 tx=0x7f0434009780 comp rx=0 tx=0).stop 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 -- 172.21.15.110:0/94431001 shutdown_connections 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c06e080 0x7f043c06e4e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 --2- 172.21.15.110:0/94431001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c155180 0x7f043c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 -- 172.21.15.110:0/94431001 >> 172.21.15.110:0/94431001 conn(0x7f043c0cb9b0 msgr2=0x7f043c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 -- 172.21.15.110:0/94431001 shutdown_connections 2024-08-17T02:29:19.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.143+0000 7f0444000640 1 -- 172.21.15.110:0/94431001 wait complete. 2024-08-17T02:29:19.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.144+0000 7f0444000640 1 Processor -- start 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.144+0000 7f0444000640 1 -- start start 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c06e080 0x7f043c16bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c155180 0x7f043c168a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c16c8c0 con 0x7f043c155550 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c16cba0 con 0x7f043c155180 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0444000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0a9a10 con 0x7f043c06e080 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0442000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0442000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49212/0 (socket says 172.21.15.110:49212) 2024-08-17T02:29:19.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0442000640 1 -- 172.21.15.110:0/2486309109 learned_addr learned my addr 172.21.15.110:0/2486309109 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:19.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0441600640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c06e080 0x7f043c16bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.145+0000 7f0440c00640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c155180 0x7f043c168a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 -- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c06e080 msgr2=0x7f043c16bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c06e080 0x7f043c16bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 -- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c155180 msgr2=0x7f043c168a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c155180 0x7f043c168a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 -- 172.21.15.110:0/2486309109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043000a530 con 0x7f043c155550 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0442000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04340099f0 tx=0x7f0434037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434031890 con 0x7f043c155550 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0434040070 con 0x7f043c155550 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0434009a20 con 0x7f043c155550 2024-08-17T02:29:19.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0434031c40 con 0x7f043c155550 2024-08-17T02:29:19.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.146+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c16c500 con 0x7f043c155550 2024-08-17T02:29:19.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.147+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0a9f10 con 0x7f043c155550 2024-08-17T02:29:19.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.148+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0434042030 con 0x7f043c155550 2024-08-17T02:29:19.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.149+0000 7f0438c00640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 0x7f041c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.149+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04340a3b80 con 0x7f043c155550 2024-08-17T02:29:19.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.149+0000 7f0441600640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 0x7f041c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.150+0000 7f0441600640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 0x7f041c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f043000a500 tx=0x7f043000a2b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.153+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0434071d10 con 0x7f043c155550 2024-08-17T02:29:19.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.359+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f043c064db0 con 0x7f043c155550 2024-08-17T02:29:19.359 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.359+0000 7f0438c00640 1 -- 172.21.15.110:0/2486309109 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0434075330 con 0x7f043c155550 2024-08-17T02:29:19.360 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:19.360 INFO:teuthology.orchestra.run.smithi110.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 msgr2=0x7f041c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 0x7f041c067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f043000a500 tx=0x7f043000a2b0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 msgr2=0x7f043c0ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f04340099f0 tx=0x7f0434037000 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 shutdown_connections 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f041c065150 0x7f041c067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f043c155550 0x7f043c0ca5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f043c155180 0x7f043c168a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 --2- 172.21.15.110:0/2486309109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f043c06e080 0x7f043c16bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 >> 172.21.15.110:0/2486309109 conn(0x7f043c0cb9b0 msgr2=0x7f043c06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 shutdown_connections 2024-08-17T02:29:19.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.361+0000 7f0444000640 1 -- 172.21.15.110:0/2486309109 wait complete. 2024-08-17T02:29:19.376 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:29:19.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:19.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.526+0000 7fab43e00640 1 Processor -- start 2024-08-17T02:29:19.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.527+0000 7fab43e00640 1 -- start start 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440aed50 0x7fab440ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab440c5c40 0x7fab440caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440cc890 con 0x7fab440ce6d0 2024-08-17T02:29:19.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440ceb20 con 0x7fab440c5c40 2024-08-17T02:29:19.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440cb4c0 con 0x7fab440aed50 2024-08-17T02:29:19.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab3be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fab440ce6d0 0x7fab440ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41418/0 (socket says 172.21.15.110:41418) 2024-08-17T02:29:19.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab3be00640 1 -- 172.21.15.110:0/2141782051 learned_addr learned my addr 172.21.15.110:0/2141782051 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:19.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab43400640 1 --2- 172.21.15.110:0/2141782051 >> v2:172.21.15.110:3300/0 conn(0x7fab440c5c40 0x7fab440caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.528+0000 7fab42a00640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440aed50 0x7fab440ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.529+0000 7fab42000640 1 -- 172.21.15.110:0/2141782051 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619342527 0 0) 0x7fab440cc890 con 0x7fab440ce6d0 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.529+0000 7fab43400640 1 -- 172.21.15.110:0/2141782051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440aed50 msgr2=0x7fab440ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.529+0000 7fab43400640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440aed50 0x7fab440ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.529+0000 7fab43400640 1 -- 172.21.15.110:0/2141782051 >> v1:172.21.15.110:6789/0 conn(0x7fab440ce6d0 legacy=0x7fab440ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.529+0000 7fab43400640 1 -- 172.21.15.110:0/2141782051 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440cb7a0 con 0x7fab440c5c40 2024-08-17T02:29:19.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43400640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440c5c40 0x7fab440caec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e60 tx=0x7fab3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21bcb30d505e51d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab42000640 1 -- 172.21.15.110:0/2141782051 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c007550 con 0x7fab440c5c40 2024-08-17T02:29:19.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab42000640 1 -- 172.21.15.110:0/2141782051 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c02d050 con 0x7fab440c5c40 2024-08-17T02:29:19.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab42000640 1 -- 172.21.15.110:0/2141782051 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c0078e0 con 0x7fab440c5c40 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 -- 172.21.15.110:0/2141782051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440c5c40 msgr2=0x7fab440caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440c5c40 0x7fab440caec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009e60 tx=0x7fab3c009780 comp rx=0 tx=0).stop 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 -- 172.21.15.110:0/2141782051 shutdown_connections 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440c5c40 0x7fab440caec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 --2- 172.21.15.110:0/2141782051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440aed50 0x7fab440ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.530+0000 7fab43e00640 1 -- 172.21.15.110:0/2141782051 >> 172.21.15.110:0/2141782051 conn(0x7fab44098e30 msgr2=0x7fab4406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.531+0000 7fab43e00640 1 -- 172.21.15.110:0/2141782051 shutdown_connections 2024-08-17T02:29:19.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.531+0000 7fab43e00640 1 -- 172.21.15.110:0/2141782051 wait complete. 2024-08-17T02:29:19.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.532+0000 7fab43e00640 1 Processor -- start 2024-08-17T02:29:19.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.532+0000 7fab43e00640 1 -- start start 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 0x7fab44156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab440ce6d0 0x7fab440b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b39f0 con 0x7fab440aed50 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b3d80 con 0x7fab440ce6d0 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b2eb0 con 0x7fab440c5c40 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab42a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab42a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49240/0 (socket says 172.21.15.110:49240) 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab42a00640 1 -- 172.21.15.110:0/3066943449 learned_addr learned my addr 172.21.15.110:0/3066943449 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab3be00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 0x7fab44156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.533+0000 7fab43400640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab440ce6d0 0x7fab440b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 -- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 msgr2=0x7fab44156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 0x7fab44156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 -- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab440ce6d0 msgr2=0x7fab440b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab440ce6d0 0x7fab440b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 -- 172.21.15.110:0/3066943449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c009a20 con 0x7fab440aed50 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab3be00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 0x7fab44156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab42a00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d890 tx=0x7fab34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400de20 con 0x7fab440aed50 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340098b0 con 0x7fab440aed50 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab440b3150 con 0x7fab440aed50 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34009c50 con 0x7fab440aed50 2024-08-17T02:29:19.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.534+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab440b3710 con 0x7fab440aed50 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.535+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab44071050 con 0x7fab440aed50 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.536+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fab34014620 con 0x7fab440aed50 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.537+0000 7fab3a000640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 0x7fab20067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.537+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab34082cf0 con 0x7fab440aed50 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.537+0000 7fab3be00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 0x7fab20067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.538+0000 7fab3be00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 0x7fab20067630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007fd0 tx=0x7fab2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.541+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fab34050d10 con 0x7fab440aed50 2024-08-17T02:29:19.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.713+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab440cd610 con 0x7fab440aed50 2024-08-17T02:29:19.715 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.714+0000 7fab3a000640 1 -- 172.21.15.110:0/3066943449 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fab34009db0 con 0x7fab440aed50 2024-08-17T02:29:19.715 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:19.715 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:19.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.716+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 msgr2=0x7fab20067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.716+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 0x7fab20067630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fab2c007fd0 tx=0x7fab2c009040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.716+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 msgr2=0x7fab440b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.716+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fab3400d890 tx=0x7fab34008040 comp rx=0 tx=0).stop 2024-08-17T02:29:19.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 shutdown_connections 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fab20065180 0x7fab20067630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab440ce6d0 0x7fab440b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab440c5c40 0x7fab44156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 --2- 172.21.15.110:0/3066943449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab440aed50 0x7fab440b2970 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 >> 172.21.15.110:0/3066943449 conn(0x7fab44098e30 msgr2=0x7fab44067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 shutdown_connections 2024-08-17T02:29:19.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.717+0000 7fab43e00640 1 -- 172.21.15.110:0/3066943449 wait complete. 2024-08-17T02:29:19.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:19.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:19.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.882+0000 7f70e3e00640 1 Processor -- start 2024-08-17T02:29:19.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.882+0000 7f70e3e00640 1 -- start start 2024-08-17T02:29:19.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.883+0000 7f70e3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70dc157e10 0x7f70dc0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.883+0000 7f70e3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0adec0 0x7f70dc15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.883+0000 7f70e3e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70dc157070 con 0x7f70dc0b0a80 2024-08-17T02:29:19.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.883+0000 7f70e3e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc0b1390 con 0x7f70dc0adec0 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.883+0000 7f70e3e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc15b410 con 0x7f70dc157e10 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0adec0 0x7f70dc15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70dc0adec0 0x7f70dc15a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49244/0 (socket says 172.21.15.110:49244) 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 -- 172.21.15.110:0/838784666 learned_addr learned my addr 172.21.15.110:0/838784666 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e0a00640 1 --2- 172.21.15.110:0/838784666 >> v2:172.21.15.177:3300/0 conn(0x7f70dc157e10 0x7f70dc0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 -- 172.21.15.110:0/838784666 >> v2:172.21.15.177:3300/0 conn(0x7f70dc157e10 msgr2=0x7f70dc0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 --2- 172.21.15.110:0/838784666 >> v2:172.21.15.177:3300/0 conn(0x7f70dc157e10 0x7f70dc0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 -- 172.21.15.110:0/838784666 >> v1:172.21.15.177:6789/0 conn(0x7f70dc0b0a80 legacy=0x7f70dc0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.884+0000 7f70e1e00640 1 -- 172.21.15.110:0/838784666 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc157330 con 0x7f70dc0adec0 2024-08-17T02:29:19.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.885+0000 7f70e1e00640 1 --2- 172.21.15.110:0/838784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0adec0 0x7f70dc15a6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70dc06c1b0 tx=0x7f70d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfdb1ca2951cb77 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.885+0000 7f70dbe00640 1 -- 172.21.15.110:0/838784666 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4031400 con 0x7f70dc0adec0 2024-08-17T02:29:19.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.885+0000 7f70dbe00640 1 -- 172.21.15.110:0/838784666 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d402d050 con 0x7f70dc0adec0 2024-08-17T02:29:19.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.885+0000 7f70dbe00640 1 -- 172.21.15.110:0/838784666 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d40317d0 con 0x7f70dc0adec0 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 -- 172.21.15.110:0/838784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0adec0 msgr2=0x7f70dc15a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 --2- 172.21.15.110:0/838784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0adec0 0x7f70dc15a6e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f70dc06c1b0 tx=0x7f70d4009840 comp rx=0 tx=0).stop 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 -- 172.21.15.110:0/838784666 shutdown_connections 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 --2- 172.21.15.110:0/838784666 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0adec0 0x7f70dc15a6e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 --2- 172.21.15.110:0/838784666 >> v2:172.21.15.177:3300/0 conn(0x7f70dc157e10 0x7f70dc0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 -- 172.21.15.110:0/838784666 >> 172.21.15.110:0/838784666 conn(0x7f70dc067750 msgr2=0x7f70dc0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 -- 172.21.15.110:0/838784666 shutdown_connections 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.886+0000 7f70e3e00640 1 -- 172.21.15.110:0/838784666 wait complete. 2024-08-17T02:29:19.887 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.887+0000 7f70e3e00640 1 Processor -- start 2024-08-17T02:29:19.888 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.887+0000 7f70e3e00640 1 -- start start 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 0x7f70dc15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 0x7f70dc15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc168d60 con 0x7f70dc0b0a80 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc169b60 con 0x7f70dc157e10 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.888+0000 7f70e3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc168f50 con 0x7f70dc0adec0 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.890 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49252/0 (socket says 172.21.15.110:49252) 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 -- 172.21.15.110:0/3159170715 learned_addr learned my addr 172.21.15.110:0/3159170715 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e1e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 0x7f70dc15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 -- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 msgr2=0x7f70dc15c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e1400640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 0x7f70dc15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 0x7f70dc15c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 -- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 msgr2=0x7f70dc15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 0x7f70dc15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 -- 172.21.15.110:0/3159170715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d4009ae0 con 0x7f70dc0b0a80 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e1e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 0x7f70dc15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e1400640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 0x7f70dc15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70e0a00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70c800ea20 tx=0x7f70c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.889+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800ca10 con 0x7f70dc0b0a80 2024-08-17T02:29:19.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.890+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800cb70 con 0x7f70dc0b0a80 2024-08-17T02:29:19.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.890+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8013470 con 0x7f70dc0b0a80 2024-08-17T02:29:19.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.890+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc169230 con 0x7f70dc0b0a80 2024-08-17T02:29:19.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.890+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc1697f0 con 0x7f70dc0b0a80 2024-08-17T02:29:19.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.891+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc169cf0 con 0x7f70dc0b0a80 2024-08-17T02:29:19.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.891+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f70c8013860 con 0x7f70dc0b0a80 2024-08-17T02:29:19.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.892+0000 7f70d8c00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 0x7f70bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:19.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.892+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70c8082880 con 0x7f70dc0b0a80 2024-08-17T02:29:19.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.892+0000 7f70e1400640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 0x7f70bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:19.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.893+0000 7f70e1400640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 0x7f70bc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70d00017a0 tx=0x7f70d0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:19.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:19.896+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70c80508a0 con 0x7f70dc0b0a80 2024-08-17T02:29:20.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.072+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70dc064db0 con 0x7f70dc0b0a80 2024-08-17T02:29:20.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.073+0000 7f70d8c00640 1 -- 172.21.15.110:0/3159170715 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70c8017020 con 0x7f70dc0b0a80 2024-08-17T02:29:20.073 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 msgr2=0x7f70bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 0x7f70bc067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f70d00017a0 tx=0x7f70d0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 msgr2=0x7f70dc14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f70c800ea20 tx=0x7f70c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 shutdown_connections 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f70bc065150 0x7f70bc067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70dc157e10 0x7f70dc15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70dc0b0a80 0x7f70dc14d420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 --2- 172.21.15.110:0/3159170715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70dc0adec0 0x7f70dc15c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 >> 172.21.15.110:0/3159170715 conn(0x7f70dc067750 msgr2=0x7f70dc1593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 shutdown_connections 2024-08-17T02:29:20.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.075+0000 7f70e3e00640 1 -- 172.21.15.110:0/3159170715 wait complete. 2024-08-17T02:29:20.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:20.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.240+0000 7fbedaa00640 1 Processor -- start 2024-08-17T02:29:20.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.240+0000 7fbedaa00640 1 -- start start 2024-08-17T02:29:20.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.241+0000 7fbedaa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbed415c2f0 0x7fbed40af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.241+0000 7fbedaa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 0x7fbed40b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.241+0000 7fbedaa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed40b11b0 con 0x7fbed40b0d50 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.241+0000 7fbedaa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed40b1e10 con 0x7fbed415c2f0 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.241+0000 7fbedaa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed40af910 con 0x7fbed40d0890 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbed415c2f0 0x7fbed40af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbed415c2f0 0x7fbed40af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49254/0 (socket says 172.21.15.110:49254) 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 -- 172.21.15.110:0/1734416594 learned_addr learned my addr 172.21.15.110:0/1734416594 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3400640 1 --2- 172.21.15.110:0/1734416594 >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 0x7fbed40b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 -- 172.21.15.110:0/1734416594 >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 msgr2=0x7fbed40b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 --2- 172.21.15.110:0/1734416594 >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 0x7fbed40b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 -- 172.21.15.110:0/1734416594 >> v1:172.21.15.110:6789/0 conn(0x7fbed40b0d50 legacy=0x7fbed40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3e00640 1 -- 172.21.15.110:0/1734416594 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed40afbb0 con 0x7fbed415c2f0 2024-08-17T02:29:20.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed3400640 1 --2- 172.21.15.110:0/1734416594 >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 0x7fbed40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.242+0000 7fbed2a00640 1 -- 172.21.15.110:0/1734416594 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698385132 0 0) 0x7fbecc001490 con 0x7fbed40b0d50 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.243+0000 7fbed3e00640 1 --2- 172.21.15.110:0/1734416594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed415c2f0 0x7fbed40af3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed405eb90 tx=0x7fbec40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72552be0a2144dea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.243+0000 7fbed2a00640 1 -- 172.21.15.110:0/1734416594 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec402ae80 con 0x7fbed415c2f0 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.243+0000 7fbed2a00640 1 -- 172.21.15.110:0/1734416594 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4032440 con 0x7fbed415c2f0 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.243+0000 7fbed2a00640 1 -- 172.21.15.110:0/1734416594 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40327c0 con 0x7fbed415c2f0 2024-08-17T02:29:20.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 -- 172.21.15.110:0/1734416594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed415c2f0 msgr2=0x7fbed40af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 --2- 172.21.15.110:0/1734416594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed415c2f0 0x7fbed40af3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbed405eb90 tx=0x7fbec40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 -- 172.21.15.110:0/1734416594 shutdown_connections 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 --2- 172.21.15.110:0/1734416594 >> v2:172.21.15.177:3300/0 conn(0x7fbed40d0890 0x7fbed40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 --2- 172.21.15.110:0/1734416594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed415c2f0 0x7fbed40af3d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 -- 172.21.15.110:0/1734416594 >> 172.21.15.110:0/1734416594 conn(0x7fbed40cfdb0 msgr2=0x7fbed40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 -- 172.21.15.110:0/1734416594 shutdown_connections 2024-08-17T02:29:20.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.244+0000 7fbedaa00640 1 -- 172.21.15.110:0/1734416594 wait complete. 2024-08-17T02:29:20.248 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.245+0000 7fbedaa00640 1 Processor -- start 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.245+0000 7fbedaa00640 1 -- start start 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 0x7fbed409c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 0x7fbed40ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed409da80 con 0x7fbed40b0d50 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed40cdc40 con 0x7fbed415c2f0 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbedaa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed409d1e0 con 0x7fbed40d0890 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.246+0000 7fbed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49270/0 (socket says 172.21.15.110:49270) 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 -- 172.21.15.110:0/3760904485 learned_addr learned my addr 172.21.15.110:0/3760904485 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3400640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 0x7fbed409c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed8a00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 0x7fbed40ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.249 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 -- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 msgr2=0x7fbed409c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 0x7fbed409c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 -- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 msgr2=0x7fbed40ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 0x7fbed40ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 -- 172.21.15.110:0/3760904485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4009450 con 0x7fbed40b0d50 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3400640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 0x7fbed409c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed8a00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 0x7fbed40ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbed3e00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009210 tx=0x7fbec4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.247+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4031a60 con 0x7fbed40b0d50 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.248+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4031be0 con 0x7fbed40b0d50 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.248+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec403d420 con 0x7fbed40b0d50 2024-08-17T02:29:20.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.248+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed409d4c0 con 0x7fbed40b0d50 2024-08-17T02:29:20.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.248+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed4149080 con 0x7fbed40b0d50 2024-08-17T02:29:20.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.249+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed4071050 con 0x7fbed40b0d50 2024-08-17T02:29:20.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.249+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbec4039040 con 0x7fbed40b0d50 2024-08-17T02:29:20.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.250+0000 7fbecb400640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 0x7fbeb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.250+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbec40a2120 con 0x7fbed40b0d50 2024-08-17T02:29:20.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.250+0000 7fbed3400640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 0x7fbeb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.251+0000 7fbed3400640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 0x7fbeb4067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006e70 tx=0x7fbec0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.254+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbec4070140 con 0x7fbed40b0d50 2024-08-17T02:29:20.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.425+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbed40cd8f0 con 0x7fbed40b0d50 2024-08-17T02:29:20.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.425+0000 7fbecb400640 1 -- 172.21.15.110:0/3760904485 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbec4073760 con 0x7fbed40b0d50 2024-08-17T02:29:20.426 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 msgr2=0x7fbeb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 0x7fbeb4067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006e70 tx=0x7fbec0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 msgr2=0x7fbed414bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009210 tx=0x7fbec4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 shutdown_connections 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbeb4065150 0x7fbeb4067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbed415c2f0 0x7fbed40ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbed40d0890 0x7fbed409c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 --2- 172.21.15.110:0/3760904485 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbed40b0d50 0x7fbed414bc20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 >> 172.21.15.110:0/3760904485 conn(0x7fbed40cfdb0 msgr2=0x7fbed415ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 shutdown_connections 2024-08-17T02:29:20.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.427+0000 7fbedaa00640 1 -- 172.21.15.110:0/3760904485 wait complete. 2024-08-17T02:29:20.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.592+0000 7f4287200640 1 Processor -- start 2024-08-17T02:29:20.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.592+0000 7f4287200640 1 -- start start 2024-08-17T02:29:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f4287200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42800d0890 0x7f42800b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.594 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f4287200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42800b0d50 0x7f42800b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f4287200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42800b1180 con 0x7f428015c2f0 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f4287200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800b1e10 con 0x7f42800d0890 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f4287200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800afbb0 con 0x7f42800b0d50 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f427f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42800d0890 0x7f42800b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f427f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42800d0890 0x7f42800b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49282/0 (socket says 172.21.15.110:49282) 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.593+0000 7f427f400640 1 -- 172.21.15.110:0/4003613691 learned_addr learned my addr 172.21.15.110:0/4003613691 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.594+0000 7f4285200640 1 --2- 172.21.15.110:0/4003613691 >> v2:172.21.15.177:3300/0 conn(0x7f42800b0d50 0x7f42800b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.594+0000 7f427f400640 1 -- 172.21.15.110:0/4003613691 >> v2:172.21.15.177:3300/0 conn(0x7f42800b0d50 msgr2=0x7f42800b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.594+0000 7f427f400640 1 --2- 172.21.15.110:0/4003613691 >> v2:172.21.15.177:3300/0 conn(0x7f42800b0d50 0x7f42800b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.594+0000 7f427f400640 1 -- 172.21.15.110:0/4003613691 >> v1:172.21.15.177:6789/0 conn(0x7f428015c2f0 legacy=0x7f42800af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.595 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.594+0000 7f427f400640 1 -- 172.21.15.110:0/4003613691 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800afe90 con 0x7f42800d0890 2024-08-17T02:29:20.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f427f400640 1 --2- 172.21.15.110:0/4003613691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800d0890 0x7f42800b0810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4280088fd0 tx=0x7f426c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c863099e9a90415a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f427ea00640 1 -- 172.21.15.110:0/4003613691 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c02add0 con 0x7f42800d0890 2024-08-17T02:29:20.596 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f427ea00640 1 -- 172.21.15.110:0/4003613691 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c032440 con 0x7f42800d0890 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f427ea00640 1 -- 172.21.15.110:0/4003613691 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c032820 con 0x7f42800d0890 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f4287200640 1 -- 172.21.15.110:0/4003613691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800d0890 msgr2=0x7f42800b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.595+0000 7f4287200640 1 --2- 172.21.15.110:0/4003613691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800d0890 0x7f42800b0810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4280088fd0 tx=0x7f426c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 -- 172.21.15.110:0/4003613691 shutdown_connections 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 --2- 172.21.15.110:0/4003613691 >> v2:172.21.15.177:3300/0 conn(0x7f42800b0d50 0x7f42800b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 --2- 172.21.15.110:0/4003613691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800d0890 0x7f42800b0810 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 -- 172.21.15.110:0/4003613691 >> 172.21.15.110:0/4003613691 conn(0x7f42800cfdb0 msgr2=0x7f42800d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 -- 172.21.15.110:0/4003613691 shutdown_connections 2024-08-17T02:29:20.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.596+0000 7f4287200640 1 -- 172.21.15.110:0/4003613691 wait complete. 2024-08-17T02:29:20.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.597+0000 7f4287200640 1 Processor -- start 2024-08-17T02:29:20.598 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.597+0000 7f4287200640 1 -- start start 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 0x7f428009c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f428015c2f0 0x7f428009cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cea80 con 0x7f42800b0d50 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428009aa10 con 0x7f428015c2f0 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4287200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428009a0e0 con 0x7f42800d0890 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f427fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.600 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f427fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49294/0 (socket says 172.21.15.110:49294) 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f427fe00640 1 -- 172.21.15.110:0/1809933690 learned_addr learned my addr 172.21.15.110:0/1809933690 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f4285200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f428015c2f0 0x7f428009cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.598+0000 7f427f400640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 0x7f428009c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 -- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 msgr2=0x7f428009c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 0x7f428009c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 -- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f428015c2f0 msgr2=0x7f428009cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f428015c2f0 0x7f428009cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 -- 172.21.15.110:0/1809933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009450 con 0x7f42800b0d50 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427f400640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 0x7f428009c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f427fe00640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f427000b520 tx=0x7f42700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000f510 con 0x7f42800b0d50 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000f670 con 0x7f42800b0d50 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428009a3c0 con 0x7f42800b0d50 2024-08-17T02:29:20.601 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000fa30 con 0x7f42800b0d50 2024-08-17T02:29:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.599+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42801476d0 con 0x7f42800b0d50 2024-08-17T02:29:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.600+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280071050 con 0x7f42800b0d50 2024-08-17T02:29:20.602 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.601+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f427001a400 con 0x7f42800b0d50 2024-08-17T02:29:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.602+0000 7f4277400640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 0x7f4260067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.602+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4270081f50 con 0x7f42800b0d50 2024-08-17T02:29:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.602+0000 7f427f400640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 0x7f4260067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.603 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.603+0000 7f427f400640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 0x7f4260067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f426c034000 tx=0x7f426c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.606 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.606+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f427004fff0 con 0x7f42800b0d50 2024-08-17T02:29:20.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.780+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42800899a0 con 0x7f42800b0d50 2024-08-17T02:29:20.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.780+0000 7f4277400640 1 -- 172.21.15.110:0/1809933690 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4270053610 con 0x7f42800b0d50 2024-08-17T02:29:20.781 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 msgr2=0x7f4260067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 0x7f4260067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f426c034000 tx=0x7f426c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 msgr2=0x7f4280147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f427000b520 tx=0x7f42700090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 shutdown_connections 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4260065150 0x7f4260067600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f428015c2f0 0x7f428009cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42800d0890 0x7f428009c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 --2- 172.21.15.110:0/1809933690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42800b0d50 0x7f4280147190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.782+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 >> 172.21.15.110:0/1809933690 conn(0x7f42800cfdb0 msgr2=0x7f4280159770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.783+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 shutdown_connections 2024-08-17T02:29:20.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.783+0000 7f4287200640 1 -- 172.21.15.110:0/1809933690 wait complete. 2024-08-17T02:29:20.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:20.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.944+0000 7f1bbca00640 1 Processor -- start 2024-08-17T02:29:20.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.944+0000 7f1bbca00640 1 -- start start 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bbca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bb81401b0 0x7f1bb80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bbca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bb8140580 0x7f1bb80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bbca00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb80b16d0 con 0x7f1bb80b1270 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bbca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb80cb450 con 0x7f1bb81401b0 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bbca00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb80caa80 con 0x7f1bb8140580 2024-08-17T02:29:20.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bb5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bb81401b0 0x7f1bb80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bb5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1bb81401b0 0x7f1bb80caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49300/0 (socket says 172.21.15.110:49300) 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.945+0000 7f1bb5e00640 1 -- 172.21.15.110:0/2226651940 learned_addr learned my addr 172.21.15.110:0/2226651940 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.946+0000 7f1bb5e00640 1 -- 172.21.15.110:0/2226651940 >> v2:172.21.15.177:3300/0 conn(0x7f1bb8140580 msgr2=0x7f1bb80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.946+0000 7f1bb5400640 1 --2- 172.21.15.110:0/2226651940 >> v2:172.21.15.177:3300/0 conn(0x7f1bb8140580 0x7f1bb80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.946+0000 7f1bb5e00640 1 --2- 172.21.15.110:0/2226651940 >> v2:172.21.15.177:3300/0 conn(0x7f1bb8140580 0x7f1bb80b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.946+0000 7f1bb5e00640 1 -- 172.21.15.110:0/2226651940 >> v1:172.21.15.177:6789/0 conn(0x7f1bb80b1270 legacy=0x7f1bb80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.946+0000 7f1bb5e00640 1 -- 172.21.15.110:0/2226651940 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80c9e70 con 0x7f1bb81401b0 2024-08-17T02:29:20.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.947+0000 7f1bb5e00640 1 --2- 172.21.15.110:0/2226651940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb81401b0 0x7f1bb80caf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bb806aa80 tx=0x7f1ba80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af56a1500399522b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.947+0000 7f1bb4a00640 1 -- 172.21.15.110:0/2226651940 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba802adf0 con 0x7f1bb81401b0 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.947+0000 7f1bb4a00640 1 -- 172.21.15.110:0/2226651940 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba8032440 con 0x7f1bb81401b0 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.947+0000 7f1bb4a00640 1 -- 172.21.15.110:0/2226651940 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8032820 con 0x7f1bb81401b0 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 -- 172.21.15.110:0/2226651940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb81401b0 msgr2=0x7f1bb80caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 --2- 172.21.15.110:0/2226651940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb81401b0 0x7f1bb80caf10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bb806aa80 tx=0x7f1ba80091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 -- 172.21.15.110:0/2226651940 shutdown_connections 2024-08-17T02:29:20.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 --2- 172.21.15.110:0/2226651940 >> v2:172.21.15.177:3300/0 conn(0x7f1bb8140580 0x7f1bb80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 --2- 172.21.15.110:0/2226651940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb81401b0 0x7f1bb80caf10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 -- 172.21.15.110:0/2226651940 >> 172.21.15.110:0/2226651940 conn(0x7f1bb80cb9b0 msgr2=0x7f1bb80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:20.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 -- 172.21.15.110:0/2226651940 shutdown_connections 2024-08-17T02:29:20.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.948+0000 7f1bbca00640 1 -- 172.21.15.110:0/2226651940 wait complete. 2024-08-17T02:29:20.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.949+0000 7f1bbca00640 1 Processor -- start 2024-08-17T02:29:20.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.949+0000 7f1bbca00640 1 -- start start 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb80b1270 0x7f1bb813ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb81401b0 0x7f1bb80a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80a7210 con 0x7f1bb8140580 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80a74f0 con 0x7f1bb80b1270 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bbca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80a77d0 con 0x7f1bb81401b0 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bb6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bb6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49310/0 (socket says 172.21.15.110:49310) 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.950+0000 7f1bb6800640 1 -- 172.21.15.110:0/3781157382 learned_addr learned my addr 172.21.15.110:0/3781157382 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb5400640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb81401b0 0x7f1bb80a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb5e00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb80b1270 0x7f1bb813ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 -- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb81401b0 msgr2=0x7f1bb80a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb81401b0 0x7f1bb80a67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 -- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb80b1270 msgr2=0x7f1bb813ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb80b1270 0x7f1bb813ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 -- 172.21.15.110:0/3781157382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba8009450 con 0x7f1bb8140580 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bb6800640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c7c0 tx=0x7f1bb00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000a640 con 0x7f1bb8140580 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000a7c0 con 0x7f1bb8140580 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000ab80 con 0x7f1bb8140580 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb80aabd0 con 0x7f1bb8140580 2024-08-17T02:29:20.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.951+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb80a86d0 con 0x7f1bb8140580 2024-08-17T02:29:20.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.953+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb80aaa00 con 0x7f1bb8140580 2024-08-17T02:29:20.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.953+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1bb0003030 con 0x7f1bb8140580 2024-08-17T02:29:20.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.954+0000 7f1bad600640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 0x7f1b98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:20.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.954+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1bb0082230 con 0x7f1bb8140580 2024-08-17T02:29:20.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.954+0000 7f1bb5e00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 0x7f1b98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:20.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.955+0000 7f1bb5e00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 0x7f1b98067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8034000 tx=0x7f1ba8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:20.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:20.958+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1bb00502f0 con 0x7f1bb8140580 2024-08-17T02:29:21.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.168+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bb80b16d0 con 0x7f1bb8140580 2024-08-17T02:29:21.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.169+0000 7f1bad600640 1 -- 172.21.15.110:0/3781157382 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f1bb80b16d0 con 0x7f1bb8140580 2024-08-17T02:29:21.169 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:21.169 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:21.170 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 msgr2=0x7f1b98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 0x7f1b98067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8034000 tx=0x7f1ba8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.171 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 msgr2=0x7f1bb813e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000c7c0 tx=0x7f1bb00015f0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 shutdown_connections 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1b98065150 0x7f1b98067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bb8140580 0x7f1bb813e010 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bb81401b0 0x7f1bb80a67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 --2- 172.21.15.110:0/3781157382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bb80b1270 0x7f1bb813ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 >> 172.21.15.110:0/3781157382 conn(0x7f1bb80cb9b0 msgr2=0x7f1bb80cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 shutdown_connections 2024-08-17T02:29:21.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.171+0000 7f1bbca00640 1 -- 172.21.15.110:0/3781157382 wait complete. 2024-08-17T02:29:21.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.334+0000 7fbf3b800640 1 Processor -- start 2024-08-17T02:29:21.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.334+0000 7fbf3b800640 1 -- start start 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf3b800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf340b1440 0x7fbf340caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf3b800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf34140580 0x7fbf340c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf3b800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340caa80 con 0x7fbf341401b0 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf3b800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340cb450 con 0x7fbf34140580 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf3b800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340c9e70 con 0x7fbf340b1440 2024-08-17T02:29:21.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.335+0000 7fbf39800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf34140580 0x7fbf340c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf34140580 0x7fbf340c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49316/0 (socket says 172.21.15.110:49316) 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 -- 172.21.15.110:0/3057341867 learned_addr learned my addr 172.21.15.110:0/3057341867 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:21.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf33e00640 1 --2- 172.21.15.110:0/3057341867 >> v2:172.21.15.177:3300/0 conn(0x7fbf340b1440 0x7fbf340caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 -- 172.21.15.110:0/3057341867 >> v2:172.21.15.177:3300/0 conn(0x7fbf340b1440 msgr2=0x7fbf340caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 --2- 172.21.15.110:0/3057341867 >> v2:172.21.15.177:3300/0 conn(0x7fbf340b1440 0x7fbf340caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 -- 172.21.15.110:0/3057341867 >> v1:172.21.15.177:6789/0 conn(0x7fbf341401b0 legacy=0x7fbf340b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.336+0000 7fbf39800640 1 -- 172.21.15.110:0/3057341867 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340ca150 con 0x7fbf34140580 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.337+0000 7fbf39800640 1 --2- 172.21.15.110:0/3057341867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf340c9040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf3406aa80 tx=0x7fbf2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214410cb72456119 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.337+0000 7fbf33400640 1 -- 172.21.15.110:0/3057341867 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c02e050 con 0x7fbf34140580 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.337+0000 7fbf33400640 1 -- 172.21.15.110:0/3057341867 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c007400 con 0x7fbf34140580 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.337+0000 7fbf33400640 1 -- 172.21.15.110:0/3057341867 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0077e0 con 0x7fbf34140580 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 -- 172.21.15.110:0/3057341867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 msgr2=0x7fbf340c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 --2- 172.21.15.110:0/3057341867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf340c9040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbf3406aa80 tx=0x7fbf2c009840 comp rx=0 tx=0).stop 2024-08-17T02:29:21.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 -- 172.21.15.110:0/3057341867 shutdown_connections 2024-08-17T02:29:21.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 --2- 172.21.15.110:0/3057341867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf340c9040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 --2- 172.21.15.110:0/3057341867 >> v2:172.21.15.177:3300/0 conn(0x7fbf340b1440 0x7fbf340caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 -- 172.21.15.110:0/3057341867 >> 172.21.15.110:0/3057341867 conn(0x7fbf340cb9b0 msgr2=0x7fbf340cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 -- 172.21.15.110:0/3057341867 shutdown_connections 2024-08-17T02:29:21.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.338+0000 7fbf3b800640 1 -- 172.21.15.110:0/3057341867 wait complete. 2024-08-17T02:29:21.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.339+0000 7fbf3b800640 1 Processor -- start 2024-08-17T02:29:21.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.339+0000 7fbf3b800640 1 -- start start 2024-08-17T02:29:21.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf340b1440 0x7fbf3414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 0x7fbf340a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340c5b60 con 0x7fbf34140580 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340c5e40 con 0x7fbf341401b0 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf3b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340c6120 con 0x7fbf340b1440 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf39800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf39800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49332/0 (socket says 172.21.15.110:49332) 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.340+0000 7fbf39800640 1 -- 172.21.15.110:0/923540058 learned_addr learned my addr 172.21.15.110:0/923540058 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf33e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 0x7fbf340a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf38e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf340b1440 0x7fbf3414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 -- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf340b1440 msgr2=0x7fbf3414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf340b1440 0x7fbf3414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 -- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 msgr2=0x7fbf340a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 0x7fbf340a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 -- 172.21.15.110:0/923540058 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c009ae0 con 0x7fbf34140580 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf33e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 0x7fbf340a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf39800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c02ad60 tx=0x7fbf2c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c007170 con 0x7fbf34140580 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c033e40 con 0x7fbf34140580 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c03c640 con 0x7fbf34140580 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.341+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf340c6400 con 0x7fbf34140580 2024-08-17T02:29:21.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.342+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3414fe40 con 0x7fbf34140580 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.342+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34064db0 con 0x7fbf34140580 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.343+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf2c039050 con 0x7fbf34140580 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.344+0000 7fbf23e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 0x7fbf18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.344+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf2c0a2bc0 con 0x7fbf34140580 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.344+0000 7fbf38e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 0x7fbf18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.345+0000 7fbf38e00640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 0x7fbf18067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf280037c0 tx=0x7fbf28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.348+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf2c070be0 con 0x7fbf34140580 2024-08-17T02:29:21.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.526+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf340c9b50 con 0x7fbf34140580 2024-08-17T02:29:21.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.527+0000 7fbf23e00640 1 -- 172.21.15.110:0/923540058 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbf2c074200 con 0x7fbf34140580 2024-08-17T02:29:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:21.528 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 msgr2=0x7fbf18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 0x7fbf18067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbf280037c0 tx=0x7fbf28009040 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 msgr2=0x7fbf3406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c02ad60 tx=0x7fbf2c037000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 shutdown_connections 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbf18065150 0x7fbf18067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34140580 0x7fbf3406d010 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf341401b0 0x7fbf340a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 --2- 172.21.15.110:0/923540058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf340b1440 0x7fbf3414f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 >> 172.21.15.110:0/923540058 conn(0x7fbf340cb9b0 msgr2=0x7fbf340afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.530 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 shutdown_connections 2024-08-17T02:29:21.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.529+0000 7fbf3b800640 1 -- 172.21.15.110:0/923540058 wait complete. 2024-08-17T02:29:21.545 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:21.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:21.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.696+0000 7f887dc00640 1 Processor -- start 2024-08-17T02:29:21.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.696+0000 7f887dc00640 1 -- start start 2024-08-17T02:29:21.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f887dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f887806df00 0x7f887806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f887dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88780ab010 0x7f88780ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f887dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780af5f0 con 0x7f887815a0e0 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f887dc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8878159600 con 0x7f887806df00 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f887dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88781598e0 con 0x7f88780ab010 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f887806df00 0x7f887806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f886f400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f887815a0e0 0x7f88780aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41432/0 (socket says 172.21.15.110:41432) 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f886f400640 1 -- 172.21.15.110:0/1451602256 learned_addr learned my addr 172.21.15.110:0/1451602256 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877e00640 1 -- 172.21.15.110:0/1451602256 >> v2:172.21.15.177:3300/0 conn(0x7f88780ab010 msgr2=0x7f88780ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877e00640 1 --2- 172.21.15.110:0/1451602256 >> v2:172.21.15.177:3300/0 conn(0x7f88780ab010 0x7f88780ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877e00640 1 -- 172.21.15.110:0/1451602256 >> v1:172.21.15.110:6789/0 conn(0x7f887815a0e0 legacy=0x7f88780aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877e00640 1 -- 172.21.15.110:0/1451602256 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8878159bc0 con 0x7f887806df00 2024-08-17T02:29:21.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.698+0000 7f8877400640 1 -- 172.21.15.110:0/1451602256 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573413570 0 0) 0x7f88780af5f0 con 0x7f887815a0e0 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.699+0000 7f8877e00640 1 --2- 172.21.15.110:0/1451602256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f887806df00 0x7f887806e2d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88780c8580 tx=0x7f88680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3fc1af948e8050 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.699+0000 7f8877400640 1 -- 172.21.15.110:0/1451602256 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886802adb0 con 0x7f887806df00 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.699+0000 7f8877400640 1 -- 172.21.15.110:0/1451602256 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868032440 con 0x7f887806df00 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.699+0000 7f8877400640 1 -- 172.21.15.110:0/1451602256 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680327e0 con 0x7f887806df00 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 -- 172.21.15.110:0/1451602256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f887806df00 msgr2=0x7f887806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 --2- 172.21.15.110:0/1451602256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f887806df00 0x7f887806e2d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88780c8580 tx=0x7f88680090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 -- 172.21.15.110:0/1451602256 shutdown_connections 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 --2- 172.21.15.110:0/1451602256 >> v2:172.21.15.177:3300/0 conn(0x7f88780ab010 0x7f88780ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 --2- 172.21.15.110:0/1451602256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f887806df00 0x7f887806e2d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 -- 172.21.15.110:0/1451602256 >> 172.21.15.110:0/1451602256 conn(0x7f8878067750 msgr2=0x7f887806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 -- 172.21.15.110:0/1451602256 shutdown_connections 2024-08-17T02:29:21.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.700+0000 7f887dc00640 1 -- 172.21.15.110:0/1451602256 wait complete. 2024-08-17T02:29:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.701+0000 7f887dc00640 1 Processor -- start 2024-08-17T02:29:21.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 -- start start 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f887806df00 0x7f8878149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f887815a0e0 0x7f88780a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878169460 con 0x7f88780ab010 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878169700 con 0x7f887806df00 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.702+0000 7f887dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88781699e0 con 0x7f887815a0e0 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49360/0 (socket says 172.21.15.110:49360) 2024-08-17T02:29:21.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 -- 172.21.15.110:0/2168609034 learned_addr learned my addr 172.21.15.110:0/2168609034 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f8877e00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f887806df00 0x7f8878149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f887d200640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f887815a0e0 0x7f88780a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 -- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f887815a0e0 msgr2=0x7f88780a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f887815a0e0 0x7f88780a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 -- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f887806df00 msgr2=0x7f8878149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f887806df00 0x7f8878149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 -- 172.21.15.110:0/2168609034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009390 con 0x7f88780ab010 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886f400640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f886000c4f0 tx=0x7f8860007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.703+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860005aa0 con 0x7f88780ab010 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.704+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860005c00 con 0x7f88780ab010 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.704+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600070d0 con 0x7f88780ab010 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.704+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8878169cc0 con 0x7f88780ab010 2024-08-17T02:29:21.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.704+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887806a4c0 con 0x7f88780ab010 2024-08-17T02:29:21.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.705+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8878071050 con 0x7f88780ab010 2024-08-17T02:29:21.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.705+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8860007500 con 0x7f88780ab010 2024-08-17T02:29:21.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.706+0000 7f886fe00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 0x7f8854067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:21.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.706+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8860081950 con 0x7f88780ab010 2024-08-17T02:29:21.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.706+0000 7f8877e00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 0x7f8854067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:21.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.707+0000 7f8877e00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 0x7f8854067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8868034000 tx=0x7f8868032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:21.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.710+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f886004f970 con 0x7f88780ab010 2024-08-17T02:29:21.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.882+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88780c8250 con 0x7f88780ab010 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.882+0000 7f886fe00640 1 -- 172.21.15.110:0/2168609034 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8860052f90 con 0x7f88780ab010 2024-08-17T02:29:21.883 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.884+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 msgr2=0x7f8854067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.884+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 0x7f8854067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8868034000 tx=0x7f8868032000 comp rx=0 tx=0).stop 2024-08-17T02:29:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.884+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 msgr2=0x7f8878069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.884+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f886000c4f0 tx=0x7f8860007f50 comp rx=0 tx=0).stop 2024-08-17T02:29:21.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 shutdown_connections 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8854065150 0x7f8854067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f887815a0e0 0x7f88780a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88780ab010 0x7f8878069730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 --2- 172.21.15.110:0/2168609034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f887806df00 0x7f8878149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 >> 172.21.15.110:0/2168609034 conn(0x7f8878067750 msgr2=0x7f8878068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 shutdown_connections 2024-08-17T02:29:21.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:21.885+0000 7f887dc00640 1 -- 172.21.15.110:0/2168609034 wait complete. 2024-08-17T02:29:21.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:22.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.049+0000 7fa124200640 1 Processor -- start 2024-08-17T02:29:22.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.049+0000 7fa124200640 1 -- start start 2024-08-17T02:29:22.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa124200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa11c155a80 0x7fa11c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa124200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa124200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c1598f0 con 0x7fa11c0c7db0 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa124200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c159bd0 con 0x7fa11c155a80 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa124200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c159eb0 con 0x7fa11c0c92e0 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.050+0000 7fa121800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa11c155a80 0x7fa11c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa11c155a80 0x7fa11c06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49376/0 (socket says 172.21.15.110:49376) 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 -- 172.21.15.110:0/1892726481 learned_addr learned my addr 172.21.15.110:0/1892726481 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa122200640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 -- 172.21.15.110:0/1892726481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 msgr2=0x7fa11c0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c0aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 -- 172.21.15.110:0/1892726481 >> v1:172.21.15.177:6789/0 conn(0x7fa11c0c7db0 legacy=0x7fa11c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa121800640 1 -- 172.21.15.110:0/1892726481 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c15a190 con 0x7fa11c155a80 2024-08-17T02:29:22.052 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.051+0000 7fa122200640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:22.053 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.052+0000 7fa121800640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c155a80 0x7fa11c06dc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa11000bbc0 tx=0x7fa11000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab34db5f89c096e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.052+0000 7fa11be00640 1 -- 172.21.15.110:0/1892726481 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110031610 con 0x7fa11c155a80 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.052+0000 7fa11be00640 1 -- 172.21.15.110:0/1892726481 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110031770 con 0x7fa11c155a80 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.052+0000 7fa11be00640 1 -- 172.21.15.110:0/1892726481 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110031b50 con 0x7fa11c155a80 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 -- 172.21.15.110:0/1892726481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c155a80 msgr2=0x7fa11c06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c155a80 0x7fa11c06dc00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa11000bbc0 tx=0x7fa11000b460 comp rx=0 tx=0).stop 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 -- 172.21.15.110:0/1892726481 shutdown_connections 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c0aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 --2- 172.21.15.110:0/1892726481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c155a80 0x7fa11c06dc00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 -- 172.21.15.110:0/1892726481 >> 172.21.15.110:0/1892726481 conn(0x7fa11c067750 msgr2=0x7fa11c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 -- 172.21.15.110:0/1892726481 shutdown_connections 2024-08-17T02:29:22.054 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.053+0000 7fa124200640 1 -- 172.21.15.110:0/1892726481 wait complete. 2024-08-17T02:29:22.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.054+0000 7fa124200640 1 Processor -- start 2024-08-17T02:29:22.055 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.054+0000 7fa124200640 1 -- start start 2024-08-17T02:29:22.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.056 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa11c155a80 0x7fa11c1511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c153d70 con 0x7fa11c0c7db0 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c154050 con 0x7fa11c155a80 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa124200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c154330 con 0x7fa11c0c92e0 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.055+0000 7fa121800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49390/0 (socket says 172.21.15.110:49390) 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 -- 172.21.15.110:0/2130015570 learned_addr learned my addr 172.21.15.110:0/2130015570 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa122200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa11c155a80 0x7fa11c1511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa120e00640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 -- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 msgr2=0x7fa11c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 -- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa11c155a80 msgr2=0x7fa11c1511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa11c155a80 0x7fa11c1511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.057 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 -- 172.21.15.110:0/2130015570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11000b700 con 0x7fa11c0c7db0 2024-08-17T02:29:22.058 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.056+0000 7fa121800640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa11000b4a0 tx=0x7fa11003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.057+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11003ad30 con 0x7fa11c0c7db0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.057+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa110040040 con 0x7fa11c0c7db0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.057+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110044640 con 0x7fa11c0c7db0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.057+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c154610 con 0x7fa11c0c7db0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.057+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c13ae10 con 0x7fa11c0c7db0 2024-08-17T02:29:22.059 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.058+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c13b000 con 0x7fa11c0c7db0 2024-08-17T02:29:22.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.058+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa110044a70 con 0x7fa11c0c7db0 2024-08-17T02:29:22.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.059+0000 7fa118c00640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 0x7fa0fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.059+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa1100a60e0 con 0x7fa11c0c7db0 2024-08-17T02:29:22.060 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.059+0000 7fa120e00640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 0x7fa0fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.061 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.060+0000 7fa120e00640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 0x7fa0fc067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa11c14de60 tx=0x7fa108007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.063+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa110074270 con 0x7fa11c0c7db0 2024-08-17T02:29:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.235+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa11c071050 con 0x7fa11c0c7db0 2024-08-17T02:29:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.235+0000 7fa118c00640 1 -- 172.21.15.110:0/2130015570 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa110077890 con 0x7fa11c0c7db0 2024-08-17T02:29:22.236 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 msgr2=0x7fa0fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 0x7fa0fc067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa11c14de60 tx=0x7fa108007e10 comp rx=0 tx=0).stop 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 msgr2=0x7fa11c13a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa11000b4a0 tx=0x7fa11003a000 comp rx=0 tx=0).stop 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 shutdown_connections 2024-08-17T02:29:22.238 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa0fc065150 0x7fa0fc067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa11c155a80 0x7fa11c1511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa11c0c92e0 0x7fa11c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 --2- 172.21.15.110:0/2130015570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa11c0c7db0 0x7fa11c13a8d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 >> 172.21.15.110:0/2130015570 conn(0x7fa11c067750 msgr2=0x7fa11c14dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.237+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 shutdown_connections 2024-08-17T02:29:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.238+0000 7fa124200640 1 -- 172.21.15.110:0/2130015570 wait complete. 2024-08-17T02:29:22.252 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.400+0000 7f2376c00640 1 Processor -- start 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.400+0000 7f2376c00640 1 -- start start 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.401+0000 7f2376c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 0x7f23700c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.401+0000 7f2376c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23700adcf0 0x7f23700ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.401+0000 7f2376c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23700ab130 con 0x7f23700abb00 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.401+0000 7f2376c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700ae5a0 con 0x7f23700adcf0 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.401+0000 7f2376c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23700ae2c0 con 0x7f2370156c50 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23700adcf0 0x7f23700ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23700adcf0 0x7f23700ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49392/0 (socket says 172.21.15.110:49392) 2024-08-17T02:29:22.403 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 -- 172.21.15.110:0/1283196247 learned_addr learned my addr 172.21.15.110:0/1283196247 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236fe00640 1 --2- 172.21.15.110:0/1283196247 >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 0x7f23700c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 -- 172.21.15.110:0/1283196247 >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 msgr2=0x7f23700c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 --2- 172.21.15.110:0/1283196247 >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 0x7f23700c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 -- 172.21.15.110:0/1283196247 >> v1:172.21.15.177:6789/0 conn(0x7f23700abb00 legacy=0x7f23700c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236f400640 1 -- 172.21.15.110:0/1283196247 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23700aaae0 con 0x7f23700adcf0 2024-08-17T02:29:22.405 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.402+0000 7f236fe00640 1 --2- 172.21.15.110:0/1283196247 >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 0x7f23700c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:22.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.403+0000 7f236f400640 1 --2- 172.21.15.110:0/1283196247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f23700ab5c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f237006efd0 tx=0x7f235c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09d7bd103e575f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.403+0000 7f236ea00640 1 -- 172.21.15.110:0/1283196247 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c02ad40 con 0x7f23700adcf0 2024-08-17T02:29:22.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.403+0000 7f236ea00640 1 -- 172.21.15.110:0/1283196247 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c032440 con 0x7f23700adcf0 2024-08-17T02:29:22.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.403+0000 7f236ea00640 1 -- 172.21.15.110:0/1283196247 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c02aea0 con 0x7f23700adcf0 2024-08-17T02:29:22.408 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 -- 172.21.15.110:0/1283196247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 msgr2=0x7f23700ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 --2- 172.21.15.110:0/1283196247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f23700ab5c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f237006efd0 tx=0x7f235c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 -- 172.21.15.110:0/1283196247 shutdown_connections 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 --2- 172.21.15.110:0/1283196247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f23700ab5c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 --2- 172.21.15.110:0/1283196247 >> v2:172.21.15.177:3300/0 conn(0x7f2370156c50 0x7f23700c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 -- 172.21.15.110:0/1283196247 >> 172.21.15.110:0/1283196247 conn(0x7f2370067750 msgr2=0x7f23700c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 -- 172.21.15.110:0/1283196247 shutdown_connections 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.404+0000 7f2376c00640 1 -- 172.21.15.110:0/1283196247 wait complete. 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.405+0000 7f2376c00640 1 Processor -- start 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.405+0000 7f2376c00640 1 -- start start 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 0x7f237015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.409 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2370156c50 0x7f2370157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370158400 con 0x7f23700adcf0 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370157560 con 0x7f2370156c50 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f2376c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23701577f0 con 0x7f23700abb00 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.406+0000 7f236f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49394/0 (socket says 172.21.15.110:49394) 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 -- 172.21.15.110:0/4028391206 learned_addr learned my addr 172.21.15.110:0/4028391206 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236fe00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 0x7f237015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f2374c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2370156c50 0x7f2370157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 -- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 msgr2=0x7f237015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.410 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 0x7f237015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 -- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2370156c50 msgr2=0x7f2370157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2370156c50 0x7f2370157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 -- 172.21.15.110:0/4028391206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c009450 con 0x7f23700adcf0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236fe00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 0x7f237015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f236f400640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f235c009210 tx=0x7f235c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c000ce0 con 0x7f23700adcf0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c031a60 con 0x7f23700adcf0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2370157ad0 con 0x7f23700adcf0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.407+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c031e40 con 0x7f23700adcf0 2024-08-17T02:29:22.411 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.408+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370158090 con 0x7f23700adcf0 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.408+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370158570 con 0x7f23700adcf0 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.409+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f235c039040 con 0x7f23700adcf0 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.410+0000 7f2367400640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 0x7f2350067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.410+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f235c0a21c0 con 0x7f23700adcf0 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.410+0000 7f236fe00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 0x7f2350067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.411+0000 7f236fe00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 0x7f2350067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f236000bc20 tx=0x7f2360008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.414+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f235c0701e0 con 0x7f23700adcf0 2024-08-17T02:29:22.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.588+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2370071050 con 0x7f23700adcf0 2024-08-17T02:29:22.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.588+0000 7f2367400640 1 -- 172.21.15.110:0/4028391206 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f235c073800 con 0x7f23700adcf0 2024-08-17T02:29:22.589 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:22.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.590+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 msgr2=0x7f2350067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.590+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 0x7f2350067600 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f236000bc20 tx=0x7f2360008040 comp rx=0 tx=0).stop 2024-08-17T02:29:22.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 msgr2=0x7f2370158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f235c009210 tx=0x7f235c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 shutdown_connections 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2350065150 0x7f2350067600 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2370156c50 0x7f2370157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23700adcf0 0x7f2370158890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 --2- 172.21.15.110:0/4028391206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23700abb00 0x7f237015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 >> 172.21.15.110:0/4028391206 conn(0x7f2370067750 msgr2=0x7f23700ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 shutdown_connections 2024-08-17T02:29:22.592 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.591+0000 7f2376c00640 1 -- 172.21.15.110:0/4028391206 wait complete. 2024-08-17T02:29:22.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:22.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.753+0000 7f0f6bc00640 1 Processor -- start 2024-08-17T02:29:22.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.753+0000 7f0f6bc00640 1 -- start start 2024-08-17T02:29:22.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.754+0000 7f0f6bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f640caa40 0x7f0f640ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.754+0000 7f0f6bc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640cb560 con 0x7f0f64159350 2024-08-17T02:29:22.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.754+0000 7f0f6bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640cf7e0 con 0x7f0f64158f80 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.754+0000 7f0f6bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f640cfac0 con 0x7f0f640caa40 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f69c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0f64159350 0x7f0f640ad380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41436/0 (socket says 172.21.15.110:41436) 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f69c00640 1 -- 172.21.15.110:0/2314588259 learned_addr learned my addr 172.21.15.110:0/2314588259 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63e00640 1 --2- 172.21.15.110:0/2314588259 >> v2:172.21.15.177:3300/0 conn(0x7f0f640caa40 0x7f0f640ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390394044 0 0) 0x7f0f640cb560 con 0x7f0f64159350 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f4c0034e0 con 0x7f0f64159350 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219074085 0 0) 0x7f0f4c0034e0 con 0x7f0f64159350 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 >> v2:172.21.15.177:3300/0 conn(0x7f0f640caa40 msgr2=0x7f0f640ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 --2- 172.21.15.110:0/2314588259 >> v2:172.21.15.177:3300/0 conn(0x7f0f640caa40 0x7f0f640ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 >> v1:172.21.15.177:6789/0 conn(0x7f0f64158f80 legacy=0x7f0f640ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640caf10 con 0x7f0f64159350 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f0f5c0017f0 con 0x7f0f64159350 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 >> v1:172.21.15.110:6789/0 conn(0x7f0f64159350 legacy=0x7f0f640ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 0x7f0f4c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c004780 0x7f0f4c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c005130 0x7f0f4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640cfac0 con 0x7f0f4c0039d0 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c00c020 con 0x7f0f4c004780 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.755+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c00c1e0 con 0x7f0f4c005130 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 0x7f0f4c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f63e00640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c004780 0x7f0f4c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69c00640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c005130 0x7f0f4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 -- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c005130 msgr2=0x7f0f4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c005130 0x7f0f4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 -- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c004780 msgr2=0x7f0f4c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c004780 0x7f0f4c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69200640 1 -- 172.21.15.110:0/2314588259 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0034e0 con 0x7f0f4c0039d0 2024-08-17T02:29:22.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.756+0000 7f0f69c00640 1 -- 172.21.15.110:0/2314588259 reap_dead start 2024-08-17T02:29:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.757+0000 7f0f69200640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 0x7f0f4c003da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f58001920 tx=0x7f0f58007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb0633763c2c4a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.757+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5802aac0 con 0x7f0f4c0039d0 2024-08-17T02:29:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.757+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5802ac40 con 0x7f0f4c0039d0 2024-08-17T02:29:22.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.757+0000 7f0f63400640 1 -- 172.21.15.110:0/2314588259 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f580323f0 con 0x7f0f4c0039d0 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 -- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 msgr2=0x7f0f4c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 0x7f0f4c003da0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f58001920 tx=0x7f0f58007c80 comp rx=0 tx=0).stop 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 -- 172.21.15.110:0/2314588259 shutdown_connections 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/2314588259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f4c0039d0 0x7f0f4c003da0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 -- 172.21.15.110:0/2314588259 >> 172.21.15.110:0/2314588259 conn(0x7f0f640cfd90 msgr2=0x7f0f640d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 -- 172.21.15.110:0/2314588259 shutdown_connections 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.758+0000 7f0f6bc00640 1 -- 172.21.15.110:0/2314588259 wait complete. 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.759+0000 7f0f6bc00640 1 Processor -- start 2024-08-17T02:29:22.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.760+0000 7f0f6bc00640 1 -- start start 2024-08-17T02:29:22.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 0x7f0f64169600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6416d080 0x7f0f640c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 0x7f0f64156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6415a880 con 0x7f0f64155100 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6415ab60 con 0x7f0f6416d080 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f6bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6415ae40 con 0x7f0f4c0039d0 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 0x7f0f64169600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 0x7f0f64156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 0x7f0f64169600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:52080/0 (socket says 172.21.15.110:52080) 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69200640 1 -- 172.21.15.110:0/3067761883 learned_addr learned my addr 172.21.15.110:0/3067761883 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f63e00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6416d080 0x7f0f640c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 -- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 msgr2=0x7f0f64169600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 0x7f0f64169600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 -- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6416d080 msgr2=0x7f0f640c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6416d080 0x7f0f640c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.761+0000 7f0f69c00640 1 -- 172.21.15.110:0/3067761883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f641690e0 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f69c00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 0x7f0f64156c30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f64064610 tx=0x7f0f5c002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00a6e0 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c00a860 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00ac20 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f64168d90 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.762+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64169ce0 con 0x7f0f64155100 2024-08-17T02:29:22.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.763+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f641692d0 con 0x7f0f64155100 2024-08-17T02:29:22.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.764+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0f5c013600 con 0x7f0f64155100 2024-08-17T02:29:22.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.765+0000 7f0f57e00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 0x7f0f44067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:22.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.765+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f5c082600 con 0x7f0f64155100 2024-08-17T02:29:22.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.765+0000 7f0f69200640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 0x7f0f44067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:22.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.765+0000 7f0f69200640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 0x7f0f44067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000c00 tx=0x7f0f58003000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:22.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.768+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0f5c0506d0 con 0x7f0f64155100 2024-08-17T02:29:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.979+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f6415af80 con 0x7f0f64155100 2024-08-17T02:29:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.980+0000 7f0f57e00640 1 -- 172.21.15.110:0/3067761883 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f0f6415af80 con 0x7f0f64155100 2024-08-17T02:29:22.981 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:22.981 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:22.981 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 msgr2=0x7f0f44067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 0x7f0f44067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f58000c00 tx=0x7f0f58003000 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 msgr2=0x7f0f64156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 0x7f0f64156c30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0f64064610 tx=0x7f0f5c002120 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 shutdown_connections 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0f44065150 0x7f0f44067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f64155100 0x7f0f64156c30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6416d080 0x7f0f640c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 --2- 172.21.15.110:0/3067761883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0039d0 0x7f0f64169600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 >> 172.21.15.110:0/3067761883 conn(0x7f0f640cfd90 msgr2=0x7f0f640cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 shutdown_connections 2024-08-17T02:29:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:22.982+0000 7f0f6bc00640 1 -- 172.21.15.110:0/3067761883 wait complete. 2024-08-17T02:29:22.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:23.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.142+0000 7fa633800640 1 Processor -- start 2024-08-17T02:29:23.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.142+0000 7fa633800640 1 -- start start 2024-08-17T02:29:23.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c158ce0 0x7fa62c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa62c0d08d0 0x7fa62c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa62c0cac30 0x7fa62c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c0cf0c0 con 0x7fa62c0cac30 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c089000 con 0x7fa62c0d08d0 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa633800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0ceb20 con 0x7fa62c158ce0 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa62c0cac30 0x7fa62c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa62c0cac30 0x7fa62c0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49422/0 (socket says 172.21.15.110:49422) 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 -- 172.21.15.110:0/1955744665 learned_addr learned my addr 172.21.15.110:0/1955744665 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa630e00640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c158ce0 0x7fa62c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa623e00640 1 --2- 172.21.15.110:0/1955744665 >> v2:172.21.15.177:3300/0 conn(0x7fa62c0d08d0 0x7fa62c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 -- 172.21.15.110:0/1955744665 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c158ce0 msgr2=0x7fa62c0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c158ce0 0x7fa62c0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 -- 172.21.15.110:0/1955744665 >> v2:172.21.15.177:3300/0 conn(0x7fa62c0d08d0 msgr2=0x7fa62c1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 --2- 172.21.15.110:0/1955744665 >> v2:172.21.15.177:3300/0 conn(0x7fa62c0d08d0 0x7fa62c1590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.146 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.144+0000 7fa631800640 1 -- 172.21.15.110:0/1955744665 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0cede0 con 0x7fa62c0cac30 2024-08-17T02:29:23.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.145+0000 7fa631800640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c0cac30 0x7fa62c0cb0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa62c064640 tx=0x7fa624009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b546f3d3b54abe6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.145+0000 7fa62be00640 1 -- 172.21.15.110:0/1955744665 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624031400 con 0x7fa62c0cac30 2024-08-17T02:29:23.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa62be00640 1 -- 172.21.15.110:0/1955744665 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62402d050 con 0x7fa62c0cac30 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa62be00640 1 -- 172.21.15.110:0/1955744665 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240317d0 con 0x7fa62c0cac30 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 -- 172.21.15.110:0/1955744665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c0cac30 msgr2=0x7fa62c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c0cac30 0x7fa62c0cb0b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa62c064640 tx=0x7fa624009840 comp rx=0 tx=0).stop 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 -- 172.21.15.110:0/1955744665 shutdown_connections 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c0cac30 0x7fa62c0cb0b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 --2- 172.21.15.110:0/1955744665 >> v2:172.21.15.177:3300/0 conn(0x7fa62c0d08d0 0x7fa62c1590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 --2- 172.21.15.110:0/1955744665 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c158ce0 0x7fa62c0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 -- 172.21.15.110:0/1955744665 >> 172.21.15.110:0/1955744665 conn(0x7fa62c0cfdc0 msgr2=0x7fa62c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 -- 172.21.15.110:0/1955744665 shutdown_connections 2024-08-17T02:29:23.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.146+0000 7fa633800640 1 -- 172.21.15.110:0/1955744665 wait complete. 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.148+0000 7fa633800640 1 Processor -- start 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.148+0000 7fa633800640 1 -- start start 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.148+0000 7fa633800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c0cac30 0x7fa62c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa633800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62c0d08d0 0x7fa62c0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa633800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa633800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0ca010 con 0x7fa62c158ce0 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa633800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1502d0 con 0x7fa62c0d08d0 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa633800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0c9400 con 0x7fa62c0cac30 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49424/0 (socket says 172.21.15.110:49424) 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 -- 172.21.15.110:0/895251105 learned_addr learned my addr 172.21.15.110:0/895251105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa630e00640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c0cac30 0x7fa62c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa623e00640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62c0d08d0 0x7fa62c0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 -- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c0cac30 msgr2=0x7fa62c0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c0cac30 0x7fa62c0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 -- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62c0d08d0 msgr2=0x7fa62c0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62c0d08d0 0x7fa62c0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 -- 172.21.15.110:0/895251105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624009ae0 con 0x7fa62c158ce0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.149+0000 7fa631800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa624009f80 tx=0x7fa624036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.150+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624008e50 con 0x7fa62c158ce0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.150+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62403b410 con 0x7fa62c158ce0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.150+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62403b7d0 con 0x7fa62c158ce0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.150+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0c96e0 con 0x7fa62c158ce0 2024-08-17T02:29:23.152 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.150+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0c9ca0 con 0x7fa62c158ce0 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.151+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c064db0 con 0x7fa62c158ce0 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.152+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa624038050 con 0x7fa62c158ce0 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.152+0000 7fa628c00640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 0x7fa608067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.152+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa6240a3150 con 0x7fa62c158ce0 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.153+0000 7fa630e00640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 0x7fa608067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.153+0000 7fa630e00640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 0x7fa608067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00bd40 tx=0x7fa61c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.156+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa624071220 con 0x7fa62c158ce0 2024-08-17T02:29:23.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.330+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa62c150440 con 0x7fa62c158ce0 2024-08-17T02:29:23.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.331+0000 7fa628c00640 1 -- 172.21.15.110:0/895251105 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa624074840 con 0x7fa62c158ce0 2024-08-17T02:29:23.331 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:23.331 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 msgr2=0x7fa608067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 0x7fa608067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00bd40 tx=0x7fa61c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 msgr2=0x7fa62c14c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa624009f80 tx=0x7fa624036000 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 shutdown_connections 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa608065150 0x7fa608067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62c158ce0 0x7fa62c14c3a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa62c0d08d0 0x7fa62c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 --2- 172.21.15.110:0/895251105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa62c0cac30 0x7fa62c0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 >> 172.21.15.110:0/895251105 conn(0x7fa62c0cfdc0 msgr2=0x7fa62c0c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 shutdown_connections 2024-08-17T02:29:23.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.333+0000 7fa633800640 1 -- 172.21.15.110:0/895251105 wait complete. 2024-08-17T02:29:23.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:23.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.494+0000 7f23a4c00640 1 Processor -- start 2024-08-17T02:29:23.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.494+0000 7f23a4c00640 1 -- start start 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f23a4c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a0155a20 0x7f23a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 0x7f23a00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f23a4c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a0156670 con 0x7f23a0155df0 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f23a4c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a00b0350 con 0x7f23a0155a20 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f23a4c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a006e5e0 con 0x7f23a006df00 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a0155a20 0x7f23a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23a0155a20 0x7f23a00adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49436/0 (socket says 172.21.15.110:49436) 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 -- 172.21.15.110:0/873536379 learned_addr learned my addr 172.21.15.110:0/873536379 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239d400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f23a0155df0 0x7f23a006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:41444/0 (socket says 172.21.15.110:41444) 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239e800640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 0x7f23a00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 -- 172.21.15.110:0/873536379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 msgr2=0x7f23a00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 0x7f23a00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 -- 172.21.15.110:0/873536379 >> v1:172.21.15.110:6789/0 conn(0x7f23a0155df0 legacy=0x7f23a006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239de00640 1 -- 172.21.15.110:0/873536379 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a006e8c0 con 0x7f23a0155a20 2024-08-17T02:29:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239ca00640 1 -- 172.21.15.110:0/873536379 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437432147 0 0) 0x7f23a0156670 con 0x7f23a0155df0 2024-08-17T02:29:23.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.496+0000 7f239e800640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 0x7f23a00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.497+0000 7f239de00640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00adf10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2390009910 tx=0x7f23900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a8427468a84d2f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f239ca00640 1 -- 172.21.15.110:0/873536379 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239002ae40 con 0x7f23a0155a20 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f239ca00640 1 -- 172.21.15.110:0/873536379 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390032440 con 0x7f23a0155a20 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f239ca00640 1 -- 172.21.15.110:0/873536379 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23900327e0 con 0x7f23a0155a20 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 -- 172.21.15.110:0/873536379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 msgr2=0x7f23a00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00adf10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2390009910 tx=0x7f23900091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 -- 172.21.15.110:0/873536379 shutdown_connections 2024-08-17T02:29:23.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a006df00 0x7f23a00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 --2- 172.21.15.110:0/873536379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00adf10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 -- 172.21.15.110:0/873536379 >> 172.21.15.110:0/873536379 conn(0x7f23a00cb9b0 msgr2=0x7f23a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 -- 172.21.15.110:0/873536379 shutdown_connections 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.498+0000 7f23a4c00640 1 -- 172.21.15.110:0/873536379 wait complete. 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.500+0000 7f23a4c00640 1 Processor -- start 2024-08-17T02:29:23.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.500+0000 7f23a4c00640 1 -- start start 2024-08-17T02:29:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a006df00 0x7f23a00c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a0155df0 0x7f23a00a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00ac5f0 con 0x7f23a0155a20 2024-08-17T02:29:23.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00ab9e0 con 0x7f23a006df00 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f23a4c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00abcc0 con 0x7f23a0155df0 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49446/0 (socket says 172.21.15.110:49446) 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 -- 172.21.15.110:0/3065213093 learned_addr learned my addr 172.21.15.110:0/3065213093 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239e800640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a0155df0 0x7f23a00a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239de00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a006df00 0x7f23a00c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 -- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a0155df0 msgr2=0x7f23a00a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a0155df0 0x7f23a00a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 -- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a006df00 msgr2=0x7f23a00c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a006df00 0x7f23a00c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.501+0000 7f239d400640 1 -- 172.21.15.110:0/3065213093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390009450 con 0x7f23a0155a20 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f239d400640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f238c00c4f0 tx=0x7f238c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0072e0 con 0x7f23a0155a20 2024-08-17T02:29:23.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c007460 con 0x7f23a0155a20 2024-08-17T02:29:23.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0049f0 con 0x7f23a0155a20 2024-08-17T02:29:23.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a00abfa0 con 0x7f23a0155a20 2024-08-17T02:29:23.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.502+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a01509e0 con 0x7f23a0155a20 2024-08-17T02:29:23.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.503+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a00ac7a0 con 0x7f23a0155a20 2024-08-17T02:29:23.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.504+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f238c013400 con 0x7f23a0155a20 2024-08-17T02:29:23.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.505+0000 7f2395600640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 0x7f2380067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:23.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.505+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f238c081c50 con 0x7f23a0155a20 2024-08-17T02:29:23.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.505+0000 7f239de00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 0x7f2380067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:23.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.505+0000 7f239de00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 0x7f2380067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2390034000 tx=0x7f2390032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:23.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.508+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23a00ac7a0 con 0x7f23a0155a20 2024-08-17T02:29:23.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.720+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23a0064db0 con 0x7f23a0155a20 2024-08-17T02:29:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.721+0000 7f2395600640 1 -- 172.21.15.110:0/3065213093 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f238c04fd20 con 0x7f23a0155a20 2024-08-17T02:29:23.721 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:23.721 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:23.721 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.722+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 msgr2=0x7f2380067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.722+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 0x7f2380067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2390034000 tx=0x7f2390032000 comp rx=0 tx=0).stop 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.722+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 msgr2=0x7f23a00a8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.722+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f238c00c4f0 tx=0x7f238c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 shutdown_connections 2024-08-17T02:29:23.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2380065180 0x7f2380067630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23a0155df0 0x7f23a00a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23a0155a20 0x7f23a00a8af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 --2- 172.21.15.110:0/3065213093 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23a006df00 0x7f23a00c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 >> 172.21.15.110:0/3065213093 conn(0x7f23a00cb9b0 msgr2=0x7f23a00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 shutdown_connections 2024-08-17T02:29:23.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:23.723+0000 7f23a4c00640 1 -- 172.21.15.110:0/3065213093 wait complete. 2024-08-17T02:29:24.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:29:08.857999+0000', 'modified': '2024-08-17T02:29:12.480390+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/3824023642', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6834', 'nonce': 3824023642}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 3824023642}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:29:24.140 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:29:24.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-08-17T02:29:24.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.288+0000 7f31ee400640 1 Processor -- start 2024-08-17T02:29:24.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.288+0000 7f31ee400640 1 -- start start 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31ee400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31e806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31ee400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80a9a10 con 0x7f31e806da20 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31ee400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80a9cf0 con 0x7f31e8158fa0 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31ee400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80ac400 con 0x7f31e80aa7d0 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31e7400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f31e806da20 0x7f31e8158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60034/0 (socket says 172.21.15.110:60034) 2024-08-17T02:29:24.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.289+0000 7f31e7400640 1 -- 172.21.15.110:0/1623512349 learned_addr learned my addr 172.21.15.110:0/1623512349 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:24.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31e806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802402663 0 0) 0x7f31e80a9a10 con 0x7f31e806da20 2024-08-17T02:29:24.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31cc0034e0 con 0x7f31e806da20 2024-08-17T02:29:24.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584090102 0 0) 0x7f31cc0034e0 con 0x7f31e806da20 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 msgr2=0x7f31e806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31e806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 >> v1:172.21.15.177:6789/0 conn(0x7f31e8158fa0 legacy=0x7f31e80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80a9fd0 con 0x7f31e806da20 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f31d8001470 con 0x7f31e806da20 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 >> v1:172.21.15.110:6789/0 conn(0x7f31e806da20 legacy=0x7f31e8158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc003a00 0x7f31cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31cc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31cc004cc0 0x7f31cc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80ac400 con 0x7f31cc004cc0 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc00bae0 con 0x7f31cc003a00 2024-08-17T02:29:24.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.290+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc00bca0 con 0x7f31e80aa7d0 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e7e00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31cc004cc0 0x7f31cc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31cc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e7400640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc003a00 0x7f31cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 -- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc003a00 msgr2=0x7f31cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31cc003a00 0x7f31cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 -- 172.21.15.110:0/1623512349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31cc004cc0 msgr2=0x7f31cc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31cc004cc0 0x7f31cc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.291+0000 7f31e6a00640 1 -- 172.21.15.110:0/1623512349 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0034e0 con 0x7f31e80aa7d0 2024-08-17T02:29:24.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.292+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31cc004780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31e80aabc0 tx=0x7f31d40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e86518b3e8e1008c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.292+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4031400 con 0x7f31e80aa7d0 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.292+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d402d050 con 0x7f31e80aa7d0 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.292+0000 7f31e6000640 1 -- 172.21.15.110:0/1623512349 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4031790 con 0x7f31e80aa7d0 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 -- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 msgr2=0x7f31cc004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 --2- 172.21.15.110:0/1623512349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80aa7d0 0x7f31cc004780 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f31e80aabc0 tx=0x7f31d40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31e7e00640 1 -- 172.21.15.110:0/1623512349 reap_dead start 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 -- 172.21.15.110:0/1623512349 shutdown_connections 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 -- 172.21.15.110:0/1623512349 >> 172.21.15.110:0/1623512349 conn(0x7f31e80cb9b0 msgr2=0x7f31e80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 -- 172.21.15.110:0/1623512349 shutdown_connections 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.293+0000 7f31ee400640 1 -- 172.21.15.110:0/1623512349 wait complete. 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.294+0000 7f31ee400640 1 Processor -- start 2024-08-17T02:29:24.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.294+0000 7f31ee400640 1 -- start start 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e80aa7d0 0x7f31e8156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80c82d0 0x7f31e814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e816c5d0 con 0x7f31e814dbf0 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80c8760 con 0x7f31e80aa7d0 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31ee400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80c8a40 con 0x7f31e80c82d0 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.295+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42898/0 (socket says 172.21.15.110:42898) 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 -- 172.21.15.110:0/2763691776 learned_addr learned my addr 172.21.15.110:0/2763691776 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e80aa7d0 0x7f31e8156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e6a00640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80c82d0 0x7f31e814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 -- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80c82d0 msgr2=0x7f31e814d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80c82d0 0x7f31e814d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 -- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e80aa7d0 msgr2=0x7f31e8156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e80aa7d0 0x7f31e8156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 -- 172.21.15.110:0/2763691776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80c8d20 con 0x7f31e814dbf0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31e8159370 tx=0x7f31e0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31dea00640 1 -- 172.21.15.110:0/2763691776 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0006b10 con 0x7f31e814dbf0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31dea00640 1 -- 172.21.15.110:0/2763691776 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0006c70 con 0x7f31e814dbf0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80c9000 con 0x7f31e814dbf0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.296+0000 7f31dea00640 1 -- 172.21.15.110:0/2763691776 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0014480 con 0x7f31e814dbf0 2024-08-17T02:29:24.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.297+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e8156320 con 0x7f31e814dbf0 2024-08-17T02:29:24.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.298+0000 7f31dea00640 1 -- 172.21.15.110:0/2763691776 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e0007030 con 0x7f31e814dbf0 2024-08-17T02:29:24.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.299+0000 7f31dea00640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.300+0000 7f31dea00640 1 -- 172.21.15.110:0/2763691776 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31e0081730 con 0x7f31e814dbf0 2024-08-17T02:29:24.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.300+0000 7f31e7400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.300+0000 7f31e7400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001ce0 tx=0x7f31d8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.300+0000 7f31f0a05740 1 Processor -- start 2024-08-17T02:29:24.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 -- start start 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec0ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec2c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55eba4380 con 0x55b55ec2cb10 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55eb4d9e0 con 0x55b55ebea0a0 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.301+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b55eb4b170 con 0x55b55ec0ea30 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42912/0 (socket says 172.21.15.110:42912) 2024-08-17T02:29:24.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 -- 172.21.15.110:0/2639424781 learned_addr learned my addr 172.21.15.110:0/2639424781 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e6a00640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec2c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7400640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec0ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 -- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 msgr2=0x55b55ec0ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec0ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 -- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 msgr2=0x55b55ec2c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec2c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 -- 172.21.15.110:0/2639424781 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b55eafa820 con 0x55b55ec2cb10 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e6a00640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec2c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7400640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec0ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31e007fb80 tx=0x7f31e007fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6122bd9edb149732 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31d3400640 1 -- 172.21.15.110:0/2639424781 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0053410 con 0x55b55ec2cb10 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31d3400640 1 -- 172.21.15.110:0/2639424781 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0056660 con 0x55b55ec2cb10 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.302+0000 7f31d3400640 1 -- 172.21.15.110:0/2639424781 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e005a3b0 con 0x55b55ec2cb10 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 -- 172.21.15.110:0/2639424781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 msgr2=0x55b55ebe3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31e007fb80 tx=0x7f31e007fb10 comp rx=0 tx=0).stop 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 -- 172.21.15.110:0/2639424781 shutdown_connections 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe3900 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec2c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2639424781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec0ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 -- 172.21.15.110:0/2639424781 >> 172.21.15.110:0/2639424781 conn(0x55b55eb82030 msgr2=0x55b55ec30c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 -- 172.21.15.110:0/2639424781 shutdown_connections 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.303+0000 7f31f0a05740 1 -- 172.21.15.110:0/2639424781 wait complete. 2024-08-17T02:29:24.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.304+0000 7f31f0a05740 1 -- start start 2024-08-17T02:29:24.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.304+0000 7f31f0a05740 1 Processor -- start 2024-08-17T02:29:24.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ec10190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec2cb10 0x55b55ec106d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55eb46f60 con 0x55b55ebea0a0 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55eaef690 con 0x55b55ec0ea30 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b55eaef330 con 0x55b55ec2cb10 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31f0a05740 10 client.0 _ll_register_callbacks cb 0x55b55eae92b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31e7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31e7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42924/0 (socket says 172.21.15.110:42924) 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31e7400640 1 -- 172.21.15.110:0/1648886834 learned_addr learned my addr 172.21.15.110:0/1648886834 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ec10190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.305+0000 7f31e7e00640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec2cb10 0x55b55ec106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 -- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec2cb10 msgr2=0x55b55ec106d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec2cb10 0x55b55ec106d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 -- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 msgr2=0x55b55ec10190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ec10190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 -- 172.21.15.110:0/1648886834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e8156320 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31e7400640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31d8015b30 tx=0x7f31d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af9383e53d4a813 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8001470 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31d801a040 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b55eb7ad20 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31d8014d70 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31f0a05740 10 client.4629 fetch_fsmap learned FSMap version 8 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.306+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b55eb10ab0 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b55eb7ad20 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f31d8021420 con 0x55b55ebea0a0 2024-08-17T02:29:24.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 20 client.4629 populate_metadata read hostname 'smithi110' 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec40980 0x55b55ec40d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 4 client.4629 mds_command: new command op to 4260 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 --> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b55e84e3c0 con 0x55b55ec40980 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.307+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec40980 0x55b55ec40d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.308+0000 7f31e6a00640 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec40980 0x55b55ec40d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3744d747b410cece server_cookie=8a3ee306245f609 in_seq=0 out_seq=0 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.308+0000 7f31c7e00640 10 client.4629 ms_handle_connect on v2:172.21.15.177:6834/3824023642 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31c7e00640 1 -- 172.21.15.110:0/1648886834 <== mds.0 v2:172.21.15.177:6834/3824023642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55b55e84e3c0 con 0x55b55ec40980 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31c7e00640 10 client.4629 handle_command_reply: tid=0 2024-08-17T02:29:24.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 client.4629 shutdown 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 msgr2=0x55b55ec0a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31d8015b30 tx=0x7f31d8017000 comp rx=0 tx=0).stop 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 shutdown_connections 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec40980 0x55b55ec40d50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec2cb10 0x55b55ec106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ec10190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 --2- 172.21.15.110:0/1648886834 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ebea0a0 0x55b55ec0a2d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31c7e00640 0 client.4629 ms_handle_reset on v2:172.21.15.177:6834/3824023642 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.309+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 >> 172.21.15.110:0/1648886834 conn(0x55b55eb82030 msgr2=0x55b55ec30750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.310+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 shutdown_connections 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.310+0000 7f31f0a05740 1 -- 172.21.15.110:0/1648886834 wait complete. 2024-08-17T02:29:24.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.310+0000 7f31f0a05740 20 client.4629 trim_cache size 0 max 16384 2024-08-17T02:29:24.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.325+0000 7f31f0a05740 1 Processor -- start 2024-08-17T02:29:24.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.325+0000 7f31f0a05740 1 -- start start 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ebea0a0 0x55b55ec0de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ebe2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55e8c1f20 con 0x55b55ec2cb10 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55ebe68b0 con 0x55b55ec0ea30 2024-08-17T02:29:24.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b55ec12720 con 0x55b55ebea0a0 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42932/0 (socket says 172.21.15.110:42932) 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 -- 172.21.15.110:0/4073211138 learned_addr learned my addr 172.21.15.110:0/4073211138 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e6a00640 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ebe2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7400640 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ebea0a0 0x55b55ec0de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 -- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ebea0a0 msgr2=0x55b55ec0de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ebea0a0 0x55b55ec0de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 -- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 msgr2=0x55b55ebe2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ebe2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.326+0000 7f31e7e00640 1 -- 172.21.15.110:0/4073211138 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b55eb14490 con 0x55b55ec2cb10 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31e7e00640 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31e004f910 tx=0x7f31e0069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b7135a4bd45591 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31d3e00640 1 -- 172.21.15.110:0/4073211138 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e005a3b0 con 0x55b55ec2cb10 2024-08-17T02:29:24.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31d3e00640 1 -- 172.21.15.110:0/4073211138 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0051550 con 0x55b55ec2cb10 2024-08-17T02:29:24.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31d3e00640 1 -- 172.21.15.110:0/4073211138 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e000ed50 con 0x55b55ec2cb10 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 -- 172.21.15.110:0/4073211138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 msgr2=0x55b55ebe2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f31e004f910 tx=0x7f31e0069000 comp rx=0 tx=0).stop 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 -- 172.21.15.110:0/4073211138 shutdown_connections 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ebe2590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ec0ea30 0x55b55ebe2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 --2- 172.21.15.110:0/4073211138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ebea0a0 0x55b55ec0de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 -- 172.21.15.110:0/4073211138 >> 172.21.15.110:0/4073211138 conn(0x55b55eb82030 msgr2=0x55b55ebe4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 -- 172.21.15.110:0/4073211138 shutdown_connections 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.327+0000 7f31f0a05740 1 -- 172.21.15.110:0/4073211138 wait complete. 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.328+0000 7f31f0a05740 1 -- start start 2024-08-17T02:29:24.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.328+0000 7f31f0a05740 1 Processor -- start 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec9c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec14e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55ec444a0 con 0x55b55ec2cb10 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b55ec473f0 con 0x55b55ebea0a0 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b55ec163c0 con 0x55b55ec0ea30 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31f0a05740 10 client.0 _ll_register_callbacks cb 0x7f31d8001040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31e7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42946/0 (socket says 172.21.15.110:42946) 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31e7e00640 1 -- 172.21.15.110:0/2592448265 learned_addr learned my addr 172.21.15.110:0/2592448265 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.329+0000 7f31e7400640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec9c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e6a00640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec14e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 -- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 msgr2=0x55b55ec14e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec14e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 -- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 msgr2=0x55b55ec9c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec9c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 -- 172.21.15.110:0/2592448265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b55eafa820 con 0x55b55ec2cb10 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31e7e00640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31e004f8c0 tx=0x7f31e007c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbc5638b890da1a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0052f50 con 0x55b55ec2cb10 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31e005a3b0 con 0x55b55ec2cb10 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31e0056660 con 0x55b55ec2cb10 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31e0068be0 con 0x55b55ec2cb10 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31f0a05740 10 client.4635 fetch_fsmap learned FSMap version 8 2024-08-17T02:29:24.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.330+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b55eb141e0 con 0x55b55ec2cb10 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0073020 con 0x55b55ec2cb10 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f31e0053670 con 0x55b55ec2cb10 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 10 client.4635 resolve_mds: resolved name 'd' to daemon mds.d 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 20 client.4635 populate_metadata read hostname 'smithi110' 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec2de70 0x55b55ec30ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 4 client.4635 mds_command: new command op to 4260 tid=0[{"prefix": "status"}] 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 --> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b55e85f6c0 con 0x55b55ec2de70 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.331+0000 7f31e7400640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec2de70 0x55b55ec30ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:24.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31e7400640 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec2de70 0x55b55ec30ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307b5a4e22deb993 server_cookie=b27f6d8acde68f77 in_seq=0 out_seq=0 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31c7e00640 10 client.4635 ms_handle_connect on v2:172.21.15.177:6834/3824023642 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31c7e00640 1 -- 172.21.15.110:0/2592448265 <== mds.0 v2:172.21.15.177:6834/3824023642 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b55e85f6c0 con 0x55b55ec2de70 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31c7e00640 10 client.4635 handle_command_reply: tid=0 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 client.4635 shutdown 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 msgr2=0x55b55ec437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31e004f8c0 tx=0x7f31e007c000 comp rx=0 tx=0).stop 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 shutdown_connections 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:6834/3824023642,v1:172.21.15.177:6835/3824023642] conn(0x55b55ec2de70 0x55b55ec30ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b55ec2cb10 0x55b55ec437c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b55ec0ea30 0x55b55ec14e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 --2- 172.21.15.110:0/2592448265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b55ebea0a0 0x55b55ec9c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31c7e00640 0 client.4635 ms_handle_reset on v2:172.21.15.177:6834/3824023642 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 >> 172.21.15.110:0/2592448265 conn(0x55b55eb82030 msgr2=0x55b55ec0af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 shutdown_connections 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 1 -- 172.21.15.110:0/2592448265 wait complete. 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.332+0000 7f31f0a05740 20 client.4635 trim_cache size 0 max 16384 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "19a3b248-ccfd-4c4b-910e-9f89c1cc3c77", 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4260, 2024-08-17T02:29:24.339 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 14.866456627, 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 8, 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 22, 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 22, 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 21.818168746000001 2024-08-17T02:29:24.340 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 msgr2=0x7f31c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 0x7f31c8067600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f31d8001ce0 tx=0x7f31d8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 msgr2=0x7f31e80ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31e8159370 tx=0x7f31e0007f90 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 shutdown_connections 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31c8065150 0x7f31c8067600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31e814dbf0 0x7f31e80ca670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e80c82d0 0x7f31e814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 --2- 172.21.15.110:0/2763691776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e80aa7d0 0x7f31e8156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 >> 172.21.15.110:0/2763691776 conn(0x7f31e80cb9b0 msgr2=0x7f31e806fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:24.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 shutdown_connections 2024-08-17T02:29:24.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:24.333+0000 7f31ee400640 1 -- 172.21.15.110:0/2763691776 wait complete. 2024-08-17T02:29:24.347 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:29:24.373 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:29:24.373 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:29:24.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.373 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:29:24.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.409 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.509 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:24.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:24.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.513 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:29:24.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.645 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:24.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:24.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.648 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:29:24.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.688 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.792 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:24.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:24.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.795 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:29:24.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:24.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-08-17T02:29:24.931 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-08-17T02:29:24.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:24.934 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:29:24.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:29:25.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.081+0000 7ff4db800640 1 Processor -- start 2024-08-17T02:29:25.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.081+0000 7ff4db800640 1 -- start start 2024-08-17T02:29:25.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4db800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4d40b1440 0x7ff4d40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4db800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4d4140580 0x7ff4d40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4db800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d40caa80 con 0x7ff4d41401b0 2024-08-17T02:29:25.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4db800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d40cb450 con 0x7ff4d40b1440 2024-08-17T02:29:25.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4db800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d40c9e70 con 0x7ff4d4140580 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.082+0000 7ff4d3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4d40b1440 0x7ff4d40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4d40b1440 0x7ff4d40caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42960/0 (socket says 172.21.15.110:42960) 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 -- 172.21.15.110:0/3736301527 learned_addr learned my addr 172.21.15.110:0/3736301527 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d9800640 1 --2- 172.21.15.110:0/3736301527 >> v2:172.21.15.177:3300/0 conn(0x7ff4d4140580 0x7ff4d40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 -- 172.21.15.110:0/3736301527 >> v2:172.21.15.177:3300/0 conn(0x7ff4d4140580 msgr2=0x7ff4d40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 --2- 172.21.15.110:0/3736301527 >> v2:172.21.15.177:3300/0 conn(0x7ff4d4140580 0x7ff4d40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 -- 172.21.15.110:0/3736301527 >> v1:172.21.15.177:6789/0 conn(0x7ff4d41401b0 legacy=0x7ff4d40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.083+0000 7ff4d3e00640 1 -- 172.21.15.110:0/3736301527 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40ca150 con 0x7ff4d40b1440 2024-08-17T02:29:25.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.084+0000 7ff4d3e00640 1 --2- 172.21.15.110:0/3736301527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d40b1440 0x7ff4d40caf10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ca9f0 tx=0x7ff4c00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c168e59295e576e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4d3400640 1 -- 172.21.15.110:0/3736301527 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c002ae80 con 0x7ff4d40b1440 2024-08-17T02:29:25.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4d3400640 1 -- 172.21.15.110:0/3736301527 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0032440 con 0x7ff4d40b1440 2024-08-17T02:29:25.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4d3400640 1 -- 172.21.15.110:0/3736301527 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0032800 con 0x7ff4d40b1440 2024-08-17T02:29:25.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 -- 172.21.15.110:0/3736301527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d40b1440 msgr2=0x7ff4d40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 --2- 172.21.15.110:0/3736301527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d40b1440 0x7ff4d40caf10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ca9f0 tx=0x7ff4c00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 -- 172.21.15.110:0/3736301527 shutdown_connections 2024-08-17T02:29:25.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 --2- 172.21.15.110:0/3736301527 >> v2:172.21.15.177:3300/0 conn(0x7ff4d4140580 0x7ff4d40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 --2- 172.21.15.110:0/3736301527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d40b1440 0x7ff4d40caf10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 -- 172.21.15.110:0/3736301527 >> 172.21.15.110:0/3736301527 conn(0x7ff4d40cb9b0 msgr2=0x7ff4d40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 -- 172.21.15.110:0/3736301527 shutdown_connections 2024-08-17T02:29:25.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.085+0000 7ff4db800640 1 -- 172.21.15.110:0/3736301527 wait complete. 2024-08-17T02:29:25.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.087+0000 7ff4db800640 1 Processor -- start 2024-08-17T02:29:25.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.087+0000 7ff4db800640 1 -- start start 2024-08-17T02:29:25.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4d40b1440 0x7ff4d413e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4d4140580 0x7ff4d4169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c6e10 con 0x7ff4d41401b0 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4169f40 con 0x7ff4d40b1440 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4db800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c6190 con 0x7ff4d4140580 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42962/0 (socket says 172.21.15.110:42962) 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 -- 172.21.15.110:0/2323120034 learned_addr learned my addr 172.21.15.110:0/2323120034 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d9800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4d4140580 0x7ff4d4169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d8e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4d40b1440 0x7ff4d413e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 -- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4d4140580 msgr2=0x7ff4d4169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4d4140580 0x7ff4d4169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 -- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4d40b1440 msgr2=0x7ff4d413e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4d40b1440 0x7ff4d413e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.088+0000 7ff4d3e00640 1 -- 172.21.15.110:0/2323120034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0009450 con 0x7ff4d41401b0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4d3e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009210 tx=0x7ff4c0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0031bb0 con 0x7ff4d41401b0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0031d30 con 0x7ff4d41401b0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40c6470 con 0x7ff4d41401b0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0031ea0 con 0x7ff4d41401b0 2024-08-17T02:29:25.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.089+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40c6a30 con 0x7ff4d41401b0 2024-08-17T02:29:25.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.090+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d4064db0 con 0x7ff4d41401b0 2024-08-17T02:29:25.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.091+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff4c0039040 con 0x7ff4d41401b0 2024-08-17T02:29:25.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.092+0000 7ff4c7e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 0x7ff4b4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:25.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.092+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4c00a2620 con 0x7ff4d41401b0 2024-08-17T02:29:25.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.092+0000 7ff4d8e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 0x7ff4b4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:25.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.093+0000 7ff4d8e00640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 0x7ff4b4067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ca8d0 tx=0x7ff4c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:25.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.096+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff4c00706e0 con 0x7ff4d41401b0 2024-08-17T02:29:25.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.307+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4d406e030 con 0x7ff4d41401b0 2024-08-17T02:29:25.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.307+0000 7ff4c7e00640 1 -- 172.21.15.110:0/2323120034 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4c0073d00 con 0x7ff4d41401b0 2024-08-17T02:29:25.308 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:29:25.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 msgr2=0x7ff4b4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 0x7ff4b4067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ca8d0 tx=0x7ff4c8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:25.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 msgr2=0x7ff4d40c5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:25.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009210 tx=0x7ff4c0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:25.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 shutdown_connections 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff4b4065150 0x7ff4b4067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff4d4140580 0x7ff4d4169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4d41401b0 0x7ff4d40c5b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 --2- 172.21.15.110:0/2323120034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4d40b1440 0x7ff4d413e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 >> 172.21.15.110:0/2323120034 conn(0x7ff4d40cb9b0 msgr2=0x7ff4d413f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 shutdown_connections 2024-08-17T02:29:25.311 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:25.309+0000 7ff4db800640 1 -- 172.21.15.110:0/2323120034 wait complete. 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:25.325 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:29:25.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:29:25.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:29:25.326 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:29:25.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.326 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-08-17T02:29:25.361 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:25.361 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:25.361 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:25.362 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:29:25.363 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-08-17T02:29:25.363 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-08-17T02:29:25.363 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:25.364 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:29:25.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:29:25.364 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:25.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.740 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:29:25.798 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-08-17T02:29:25.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.801 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-08-17T02:29:25.865 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-08-17T02:29:25.865 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:29:25.865 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:29:25.865 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:29:25.865 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:29:25.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:29:25.866 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:26.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.444 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:29:26.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.480 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-08-17T02:29:26.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.556 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:26.556 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:26.556 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:26.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:29:26.557 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:26.683 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:29:26.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.683 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:26.683 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:26.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:29:26.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:29:26.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:29:26.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:29:26.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:29:26.684 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:26.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:26.875 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:26.875 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:26.875 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-08-17T02:29:26.875 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:29:26.875 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:26.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:26.992 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:27.030 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:29:27.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:27.030 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:27.105 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:29:27.105 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:27.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:27.245 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:27.245 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:27.865 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:29:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 0@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:29:27.866 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:29:27.867 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:29:27.867 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:29:27.867 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:29:27.867 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:29:27.867 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:29:27.870 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:29:27.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:27.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:29:27.927 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:29:27.927 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:29:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.075+0000 7fc323200640 1 Processor -- start 2024-08-17T02:29:28.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.075+0000 7fc323200640 1 -- start start 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.076+0000 7fc323200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc31c155a20 0x7fc31c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.076+0000 7fc323200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc31c155df0 0x7fc31c0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.076+0000 7fc323200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c156670 con 0x7fc31c06d7f0 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.076+0000 7fc323200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0b0350 con 0x7fc31c155df0 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.076+0000 7fc323200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c06e5e0 con 0x7fc31c155a20 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc31c155df0 0x7fc31c0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc321200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc31c06d7f0 0x7fc31c0ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60050/0 (socket says 172.21.15.110:60050) 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc321200640 1 -- 172.21.15.110:0/2184986759 learned_addr learned my addr 172.21.15.110:0/2184986759 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:28.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31be00640 1 --2- 172.21.15.110:0/2184986759 >> v2:172.21.15.177:3300/0 conn(0x7fc31c155a20 0x7fc31c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31b400640 1 -- 172.21.15.110:0/2184986759 >> v2:172.21.15.177:3300/0 conn(0x7fc31c155a20 msgr2=0x7fc31c0adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:28.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31b400640 1 --2- 172.21.15.110:0/2184986759 >> v2:172.21.15.177:3300/0 conn(0x7fc31c155a20 0x7fc31c0adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31b400640 1 -- 172.21.15.110:0/2184986759 >> v1:172.21.15.110:6789/0 conn(0x7fc31c06d7f0 legacy=0x7fc31c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31b400640 1 -- 172.21.15.110:0/2184986759 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c06e8c0 con 0x7fc31c155df0 2024-08-17T02:29:28.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.077+0000 7fc31aa00640 1 -- 172.21.15.110:0/2184986759 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225635177 0 0) 0x7fc31c156670 con 0x7fc31c06d7f0 2024-08-17T02:29:28.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.078+0000 7fc31b400640 1 --2- 172.21.15.110:0/2184986759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c0ad9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06bc00 tx=0x7fc3080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5606dc2d60a84c7e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.078+0000 7fc31aa00640 1 -- 172.21.15.110:0/2184986759 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30802adb0 con 0x7fc31c155df0 2024-08-17T02:29:28.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.078+0000 7fc31aa00640 1 -- 172.21.15.110:0/2184986759 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308032440 con 0x7fc31c155df0 2024-08-17T02:29:28.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.078+0000 7fc31aa00640 1 -- 172.21.15.110:0/2184986759 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080327e0 con 0x7fc31c155df0 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 -- 172.21.15.110:0/2184986759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 msgr2=0x7fc31c0ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 --2- 172.21.15.110:0/2184986759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c0ad9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc31c06bc00 tx=0x7fc3080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 -- 172.21.15.110:0/2184986759 shutdown_connections 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 --2- 172.21.15.110:0/2184986759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c0ad9b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 --2- 172.21.15.110:0/2184986759 >> v2:172.21.15.177:3300/0 conn(0x7fc31c155a20 0x7fc31c0adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 -- 172.21.15.110:0/2184986759 >> 172.21.15.110:0/2184986759 conn(0x7fc31c0cb9b0 msgr2=0x7fc31c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 -- 172.21.15.110:0/2184986759 shutdown_connections 2024-08-17T02:29:28.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.079+0000 7fc323200640 1 -- 172.21.15.110:0/2184986759 wait complete. 2024-08-17T02:29:28.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.080+0000 7fc323200640 1 Processor -- start 2024-08-17T02:29:28.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.081+0000 7fc323200640 1 -- start start 2024-08-17T02:29:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.081+0000 7fc323200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 0x7fc31c0a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.081+0000 7fc323200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 0x7fc31c0add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.081+0000 7fc323200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc323200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0ae260 con 0x7fc31c155df0 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc323200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0a77d0 con 0x7fc31c155a20 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc323200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0a6f30 con 0x7fc31c06d7f0 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:42984/0 (socket says 172.21.15.110:42984) 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 -- 172.21.15.110:0/3729833708 learned_addr learned my addr 172.21.15.110:0/3729833708 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc31be00640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 0x7fc31c0a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc31b400640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 0x7fc31c0add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 -- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 msgr2=0x7fc31c0a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 0x7fc31c0a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 -- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 msgr2=0x7fc31c0add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 0x7fc31c0add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 -- 172.21.15.110:0/3729833708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009390 con 0x7fc31c155df0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc31be00640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 0x7fc31c0a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc31b400640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 0x7fc31c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.082+0000 7fc321200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc31400cc90 tx=0x7fc314001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.083+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400a850 con 0x7fc31c155df0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.083+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31400a9b0 con 0x7fc31c155df0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.083+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0a7210 con 0x7fc31c155df0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.083+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400ad70 con 0x7fc31c155df0 2024-08-17T02:29:28.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.083+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0a8a90 con 0x7fc31c155df0 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.084+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c064db0 con 0x7fc31c155df0 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.085+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc314007300 con 0x7fc31c155df0 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.085+0000 7fc313400640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 0x7fc2fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.085+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc314082610 con 0x7fc31c155df0 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.086+0000 7fc31be00640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 0x7fc2fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:28.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.086+0000 7fc31be00640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 0x7fc2fc067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc30c006e70 tx=0x7fc30c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:28.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.090+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc3140506b0 con 0x7fc31c155df0 2024-08-17T02:29:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.298+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc31c0aeea0 con 0x7fc31c155df0 2024-08-17T02:29:28.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.299+0000 7fc313400640 1 -- 172.21.15.110:0/3729833708 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc314053cd0 con 0x7fc31c155df0 2024-08-17T02:29:28.299 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:29:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 msgr2=0x7fc2fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 0x7fc2fc067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc30c006e70 tx=0x7fc30c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 msgr2=0x7fc31c13db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:28.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc31400cc90 tx=0x7fc314001a20 comp rx=0 tx=0).stop 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 shutdown_connections 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2fc065150 0x7fc2fc067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc31c155df0 0x7fc31c13db00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc31c155a20 0x7fc31c0add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 --2- 172.21.15.110:0/3729833708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc31c06d7f0 0x7fc31c0a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 >> 172.21.15.110:0/3729833708 conn(0x7fc31c0cb9b0 msgr2=0x7fc31c156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 shutdown_connections 2024-08-17T02:29:28.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:28.301+0000 7fc323200640 1 -- 172.21.15.110:0/3729833708 wait complete. 2024-08-17T02:29:28.315 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:29:28.316 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:29:28.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.316 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-08-17T02:29:28.351 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:28.351 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:28.351 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:28.351 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:29:28.352 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 5a:8c:2c:d1:c6:0b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ac8c:adff:fee0:3d2a/64 scope link 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 5a:8c:2c:d1:c6:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::588c:2cff:fed1:c60b/64 scope link 2024-08-17T02:29:28.353 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.354 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:29:28.448 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-08-17T02:29:28.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.451 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-08-17T02:29:28.487 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-08-17T02:29:28.487 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:29:28.487 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:29:28.488 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:29:28.488 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:29:28.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:29:28.488 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:28.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.635 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:29:28.670 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:29:28.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.671 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-08-17T02:29:28.745 INFO:teuthology.orchestra.run.smithi110.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:29:28.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.747 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:28.747 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:28.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:29:28.747 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:29:28.747 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:28.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.871 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:29:28.925 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:28.925 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:28.925 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:28.925 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 6a:ac:f5:ad:ec:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::68ac:f5ff:fead:ec78/64 scope link 2024-08-17T02:29:28.926 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.929 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:29:28.983 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 6a:ac:f5:ad:ec:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::68ac:f5ff:fead:ec78/64 scope link 2024-08-17T02:29:28.984 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:28.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:29:28.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:29:28.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:29:28.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:29:28.988 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:29.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:29.153 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:29:29.153 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:29:29.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.1 up 2024-08-17T02:29:29.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:29:29.153 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:29:29.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:29.267 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:29:29.302 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:29:29.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:29.303 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:29:29.378 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:29:29.378 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:29.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:29.500 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:29.500 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:29.527 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:29.528 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:29.528 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:29:29.528 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 2@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:29:29.528 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:29:29.529 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:29:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:29:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:29:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:29:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:29:29.532 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:29:29.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:29.532 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:29:29.586 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:29:29.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:29:29.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.733+0000 7fa07de00640 1 Processor -- start 2024-08-17T02:29:29.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.733+0000 7fa07de00640 1 -- start start 2024-08-17T02:29:29.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa07de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa078155180 0x7fa07806d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa07de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa078155600 0x7fa07806dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa07de00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0780afc10 con 0x7fa0780aea20 2024-08-17T02:29:29.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa07de00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780aedf0 con 0x7fa078155180 2024-08-17T02:29:29.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa07de00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0780af000 con 0x7fa078155600 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa076a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa0780aea20 0x7fa0780ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60062/0 (socket says 172.21.15.110:60062) 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.734+0000 7fa076a00640 1 -- 172.21.15.110:0/3939254167 learned_addr learned my addr 172.21.15.110:0/3939254167 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa076000640 1 --2- 172.21.15.110:0/3939254167 >> v2:172.21.15.110:3300/0 conn(0x7fa078155180 0x7fa07806d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa077400640 1 --2- 172.21.15.110:0/3939254167 >> v2:172.21.15.177:3300/0 conn(0x7fa078155600 0x7fa07806dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa075600640 1 -- 172.21.15.110:0/3939254167 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846333686 0 0) 0x7fa0780afc10 con 0x7fa0780aea20 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa075600640 1 -- 172.21.15.110:0/3939254167 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c0034e0 con 0x7fa0780aea20 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa076000640 1 -- 172.21.15.110:0/3939254167 >> v2:172.21.15.177:3300/0 conn(0x7fa078155600 msgr2=0x7fa07806dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa076000640 1 --2- 172.21.15.110:0/3939254167 >> v2:172.21.15.177:3300/0 conn(0x7fa078155600 0x7fa07806dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa076000640 1 -- 172.21.15.110:0/3939254167 >> v1:172.21.15.110:6789/0 conn(0x7fa0780aea20 legacy=0x7fa0780ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.735+0000 7fa076000640 1 -- 172.21.15.110:0/3939254167 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780af2e0 con 0x7fa078155180 2024-08-17T02:29:29.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.736+0000 7fa076000640 1 --2- 172.21.15.110:0/3939254167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155180 0x7fa07806d7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cca70 tx=0x7fa0640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e168112368dd9676 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.736+0000 7fa075600640 1 -- 172.21.15.110:0/3939254167 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06402adb0 con 0x7fa078155180 2024-08-17T02:29:29.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.736+0000 7fa075600640 1 -- 172.21.15.110:0/3939254167 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064032440 con 0x7fa078155180 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.736+0000 7fa075600640 1 -- 172.21.15.110:0/3939254167 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064032820 con 0x7fa078155180 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 -- 172.21.15.110:0/3939254167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155180 msgr2=0x7fa07806d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 --2- 172.21.15.110:0/3939254167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155180 0x7fa07806d7f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0780cca70 tx=0x7fa0640090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 -- 172.21.15.110:0/3939254167 shutdown_connections 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 --2- 172.21.15.110:0/3939254167 >> v2:172.21.15.177:3300/0 conn(0x7fa078155600 0x7fa07806dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 --2- 172.21.15.110:0/3939254167 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155180 0x7fa07806d7f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 -- 172.21.15.110:0/3939254167 >> 172.21.15.110:0/3939254167 conn(0x7fa0780cb9b0 msgr2=0x7fa0780cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 -- 172.21.15.110:0/3939254167 shutdown_connections 2024-08-17T02:29:29.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.737+0000 7fa07de00640 1 -- 172.21.15.110:0/3939254167 wait complete. 2024-08-17T02:29:29.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.738+0000 7fa07de00640 1 Processor -- start 2024-08-17T02:29:29.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 -- start start 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0780aea20 0x7fa078151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 0x7fa0780c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c37d0 con 0x7fa078155600 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c6780 con 0x7fa078155180 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.739+0000 7fa07de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c6450 con 0x7fa0780aea20 2024-08-17T02:29:29.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43008/0 (socket says 172.21.15.110:43008) 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 -- 172.21.15.110:0/4240157230 learned_addr learned my addr 172.21.15.110:0/4240157230 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa076a00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0780aea20 0x7fa078151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa076000640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 0x7fa0780c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 -- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0780aea20 msgr2=0x7fa078151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0780aea20 0x7fa078151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 -- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 msgr2=0x7fa0780c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 0x7fa0780c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 -- 172.21.15.110:0/4240157230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064009390 con 0x7fa078155600 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa076000640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 0x7fa0780c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.740+0000 7fa077400640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa070009df0 tx=0x7fa07000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.741+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000cd40 con 0x7fa078155600 2024-08-17T02:29:29.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.741+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07000f040 con 0x7fa078155600 2024-08-17T02:29:29.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.741+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700146d0 con 0x7fa078155600 2024-08-17T02:29:29.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.741+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0780c2f30 con 0x7fa078155600 2024-08-17T02:29:29.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.741+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780c34f0 con 0x7fa078155600 2024-08-17T02:29:29.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.742+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0780c6910 con 0x7fa078155600 2024-08-17T02:29:29.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.743+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa070014a80 con 0x7fa078155600 2024-08-17T02:29:29.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.743+0000 7fa06e000640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 0x7fa058067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:29.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.744+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa070082e00 con 0x7fa078155600 2024-08-17T02:29:29.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.744+0000 7fa076a00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 0x7fa058067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:29.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.744+0000 7fa076a00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 0x7fa058067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa068005840 tx=0x7fa068009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:29.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.747+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa070050ec0 con 0x7fa078155600 2024-08-17T02:29:29.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.957+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa078064db0 con 0x7fa078155600 2024-08-17T02:29:29.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.958+0000 7fa06e000640 1 -- 172.21.15.110:0/4240157230 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa070018070 con 0x7fa078155600 2024-08-17T02:29:29.959 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 msgr2=0x7fa058067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 0x7fa058067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa068005840 tx=0x7fa068009040 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 msgr2=0x7fa0780c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa070009df0 tx=0x7fa07000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 shutdown_connections 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa058065150 0x7fa058067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa078155600 0x7fa0780c9850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa078155180 0x7fa0780c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 --2- 172.21.15.110:0/4240157230 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0780aea20 0x7fa078151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:29.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 >> 172.21.15.110:0/4240157230 conn(0x7fa0780cb9b0 msgr2=0x7fa078069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:29.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 shutdown_connections 2024-08-17T02:29:29.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:29.960+0000 7fa07de00640 1 -- 172.21.15.110:0/4240157230 wait complete. 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:29.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:29:29.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:29:29.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:29:29.977 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:29:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:29.977 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42654sec preferred_lft 42654sec 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:30.018 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:29:30.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:29:30.019 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:30.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:30.394 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:29:30.450 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-08-17T02:29:30.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:30.454 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:29:30.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:30.508 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:30.508 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:30.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:29:30.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:29:30.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:29:30.509 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:31.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.032 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:29:31.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.068 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-08-17T02:29:31.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.142 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:31.142 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:31.142 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:31.142 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:29:31.142 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:31.267 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:29:31.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:29:31.268 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:31.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:31.482 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:31.482 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:31.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-08-17T02:29:31.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:29:31.483 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:31.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:31.599 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:31.633 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:29:31.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:31.634 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:31.708 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:29:31.708 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:31.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:31.840 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:31.840 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:32.457 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:29:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 1@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:29:32.458 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:29:32.459 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:29:32.459 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:29:32.459 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:29:32.459 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:29:32.459 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:29:32.462 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:29:32.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:32.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:29:32.519 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:29:32.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:29:32.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.675+0000 7f8a4ec00640 1 Processor -- start 2024-08-17T02:29:32.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.675+0000 7f8a4ec00640 1 -- start start 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.676+0000 7f8a4ec00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a4806df00 0x7f8a480adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.676+0000 7f8a4ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a48156670 con 0x7f8a48155df0 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.676+0000 7f8a4ec00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4806e5e0 con 0x7f8a48155a20 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.676+0000 7f8a4ec00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a480b0350 con 0x7f8a4806df00 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a4cc00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8a48155df0 0x7f8a48156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:60070/0 (socket says 172.21.15.110:60070) 2024-08-17T02:29:32.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a4cc00640 1 -- 172.21.15.110:0/1915450275 learned_addr learned my addr 172.21.15.110:0/1915450275 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:32.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a3f400640 1 --2- 172.21.15.110:0/1915450275 >> v2:172.21.15.177:3300/0 conn(0x7f8a4806df00 0x7f8a480adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374335620 0 0) 0x7f8a48156670 con 0x7f8a48155df0 2024-08-17T02:29:32.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a2c0034e0 con 0x7f8a48155df0 2024-08-17T02:29:32.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850518268 0 0) 0x7f8a4806e5e0 con 0x7f8a48155a20 2024-08-17T02:29:32.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.677+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a48156670 con 0x7f8a48155a20 2024-08-17T02:29:32.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.678+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1119652987 0 0) 0x7f8a2c0034e0 con 0x7f8a48155df0 2024-08-17T02:29:32.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.678+0000 7f8a3f400640 1 -- 172.21.15.110:0/1915450275 >> v1:172.21.15.177:6789/0 conn(0x7f8a48155a20 legacy=0x7f8a4806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.678+0000 7f8a3f400640 1 -- 172.21.15.110:0/1915450275 >> v1:172.21.15.110:6789/0 conn(0x7f8a48155df0 legacy=0x7f8a48156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.678+0000 7f8a3f400640 1 -- 172.21.15.110:0/1915450275 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4806e8c0 con 0x7f8a4806df00 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a3f400640 1 --2- 172.21.15.110:0/1915450275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a480adf10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009850 tx=0x7f8a300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a4a3a7bd5642187 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400017f0 con 0x7f8a4806df00 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3002aa50 con 0x7f8a4806df00 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a47400640 1 -- 172.21.15.110:0/1915450275 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3002adf0 con 0x7f8a4806df00 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a4ec00640 1 -- 172.21.15.110:0/1915450275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 msgr2=0x7f8a480adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.679+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/1915450275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a480adf10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009850 tx=0x7f8a300090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.680+0000 7f8a4ec00640 1 -- 172.21.15.110:0/1915450275 shutdown_connections 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.680+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/1915450275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a480adf10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.680+0000 7f8a4ec00640 1 -- 172.21.15.110:0/1915450275 >> 172.21.15.110:0/1915450275 conn(0x7f8a480cb9b0 msgr2=0x7f8a480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.680+0000 7f8a4ec00640 1 -- 172.21.15.110:0/1915450275 shutdown_connections 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.680+0000 7f8a4ec00640 1 -- 172.21.15.110:0/1915450275 wait complete. 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.681+0000 7f8a4ec00640 1 Processor -- start 2024-08-17T02:29:32.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.681+0000 7f8a4ec00640 1 -- start start 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a481443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a48155a20 0x7f8a481691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4815c620 con 0x7f8a48155df0 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4815cba0 con 0x7f8a4806df00 2024-08-17T02:29:32.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48169cb0 con 0x7f8a48155a20 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:43018/0 (socket says 172.21.15.110:43018) 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.682+0000 7f8a4cc00640 1 -- 172.21.15.110:0/4081728065 learned_addr learned my addr 172.21.15.110:0/4081728065 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a47e00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a481443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a3f400640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a48155a20 0x7f8a481691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 -- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a48155a20 msgr2=0x7f8a481691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a48155a20 0x7f8a481691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 -- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 msgr2=0x7f8a481443b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a481443b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 -- 172.21.15.110:0/4081728065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009390 con 0x7f8a48155df0 2024-08-17T02:29:32.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4cc00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001560 tx=0x7f8a40007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40004d30 con 0x7f8a48155df0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40004e90 con 0x7f8a48155df0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a48169f90 con 0x7f8a48155df0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.683+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000aa80 con 0x7f8a48155df0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.684+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a48151910 con 0x7f8a48155df0 2024-08-17T02:29:32.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.684+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4816a1d0 con 0x7f8a48155df0 2024-08-17T02:29:32.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.685+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8a40007150 con 0x7f8a48155df0 2024-08-17T02:29:32.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.686+0000 7f8a3fe00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 0x7f8a24067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:32.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.686+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8a40081ff0 con 0x7f8a48155df0 2024-08-17T02:29:32.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.686+0000 7f8a47e00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 0x7f8a24067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:32.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.687+0000 7f8a47e00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 0x7f8a24067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a4815c420 tx=0x7f8a38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:32.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.690+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8a400500f0 con 0x7f8a48155df0 2024-08-17T02:29:32.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.902+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8a48064db0 con 0x7f8a48155df0 2024-08-17T02:29:32.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.903+0000 7f8a3fe00640 1 -- 172.21.15.110:0/4081728065 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8a40018060 con 0x7f8a48155df0 2024-08-17T02:29:32.904 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:29:32.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 msgr2=0x7f8a24067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 0x7f8a24067630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a4815c420 tx=0x7f8a38009040 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 msgr2=0x7f8a4815d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8a40001560 tx=0x7f8a40007d30 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 shutdown_connections 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a24065180 0x7f8a24067630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a48155df0 0x7f8a4815d030 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a48155a20 0x7f8a481691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 --2- 172.21.15.110:0/4081728065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a4806df00 0x7f8a481443b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 >> 172.21.15.110:0/4081728065 conn(0x7f8a480cb9b0 msgr2=0x7f8a4806d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 shutdown_connections 2024-08-17T02:29:32.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:32.905+0000 7f8a4ec00640 1 -- 172.21.15.110:0/4081728065 wait complete. 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:29:32.921 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:29:32.922 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:29:32.922 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:29:32.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:32.922 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-08-17T02:29:32.958 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:32.958 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:32.958 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:32.958 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.958 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42651sec preferred_lft 42651sec 2024-08-17T02:29:32.959 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 7e:25:22:21:42:62 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::241c:4cff:fe2b:94aa/64 scope link 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 7e:25:22:21:42:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::7c25:22ff:fe21:4262/64 scope link 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:32.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:32.961 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:29:33.052 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-08-17T02:29:33.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.055 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-08-17T02:29:33.091 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-08-17T02:29:33.091 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:29:33.091 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:29:33.091 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:29:33.091 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:29:33.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:29:33.092 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:33.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.235 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:29:33.269 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:29:33.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.271 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-08-17T02:29:33.345 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:29:33.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.346 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:33.346 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:33.346 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:29:33.346 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:29:33.346 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:33.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.472 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5a:7b:34:2d:9c:f0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:29:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.530 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::587b:34ff:fe2d:9cf0/64 scope link 2024-08-17T02:29:33.530 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.532 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:29:33.587 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:29:33.587 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:29:33.587 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:29:33.587 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.587 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5a:7b:34:2d:9c:f0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::587b:34ff:fe2d:9cf0/64 scope link 2024-08-17T02:29:33.588 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:29:33.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:29:33.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.590 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:33.590 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:29:33.591 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:33.754 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:29:33.754 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:29:33.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2024-08-17T02:29:33.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:29:33.754 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:29:33.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:33.869 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:29:33.904 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:29:33.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:29:33.904 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:29:33.980 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:29:33.980 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:29:33.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:34.102 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:34.102 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:34.128 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:29:34.128 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:29:34.128 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:29:34.128 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 3@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:29:34.128 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:29:34.129 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:29:34.129 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:29:34.129 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:29:34.129 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:29:34.129 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:29:34.132 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:29:34.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:34.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:29:34.188 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:29:34.204 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:34.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.360+0000 7fa3e1800640 1 Processor -- start 2024-08-17T02:29:34.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.360+0000 7fa3e1800640 1 -- start start 2024-08-17T02:29:34.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3e1800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3dc140580 0x7fa3dc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3e1800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc0caa80 con 0x7fa3dc0b1440 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3e1800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc0c9e70 con 0x7fa3dc1401b0 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3e1800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c9c90 con 0x7fa3dc140580 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3da000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa3dc0b1440 0x7fa3dc0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57470/0 (socket says 172.21.15.110:57470) 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3da000640 1 -- 172.21.15.110:0/3873509149 learned_addr learned my addr 172.21.15.110:0/3873509149 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3db400640 1 --2- 172.21.15.110:0/3873509149 >> v2:172.21.15.177:3300/0 conn(0x7fa3dc140580 0x7fa3dc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574298521 0 0) 0x7fa3dc0caa80 con 0x7fa3dc0b1440 2024-08-17T02:29:34.364 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.362+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c00034e0 con 0x7fa3dc0b1440 2024-08-17T02:29:34.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1075698965 0 0) 0x7fa3c00034e0 con 0x7fa3dc0b1440 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 >> v2:172.21.15.177:3300/0 conn(0x7fa3dc140580 msgr2=0x7fa3dc0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 --2- 172.21.15.110:0/3873509149 >> v2:172.21.15.177:3300/0 conn(0x7fa3dc140580 0x7fa3dc0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 >> v1:172.21.15.177:6789/0 conn(0x7fa3dc1401b0 legacy=0x7fa3dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0ca150 con 0x7fa3dc0b1440 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fa3c8001470 con 0x7fa3dc0b1440 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 >> v1:172.21.15.110:6789/0 conn(0x7fa3dc0b1440 legacy=0x7fa3dc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0004780 0x7fa3c0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c0005130 0x7fa3c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c9c90 con 0x7fa3c00039d0 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0010450 con 0x7fa3c0004780 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0010610 con 0x7fa3c0005130 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3db400640 1 --2- 172.21.15.110:0/3873509149 >> v2:172.21.15.177:3300/0 conn(0x7fa3dc140580 0x7fa3dc0c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3da000640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0004780 0x7fa3c0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3daa00640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3db400640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c0005130 0x7fa3c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.363+0000 7fa3daa00640 1 -- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c0005130 msgr2=0x7fa3c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3daa00640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c0005130 0x7fa3c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3daa00640 1 -- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0004780 msgr2=0x7fa3c0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3daa00640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0004780 0x7fa3c0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3daa00640 1 -- 172.21.15.110:0/3873509149 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00034e0 con 0x7fa3c00039d0 2024-08-17T02:29:34.368 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3db400640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c0005130 0x7fa3c000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3da000640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c0004780 0x7fa3c0004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3db400640 1 -- 172.21.15.110:0/3873509149 reap_dead start 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.364+0000 7fa3daa00640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3c0003de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001800 tx=0x7fa3cc007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9c137b7719ab80 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc02a8e0 con 0x7fa3c00039d0 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc02aa60 con 0x7fa3c00039d0 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3d9600640 1 -- 172.21.15.110:0/3873509149 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc02ae20 con 0x7fa3c00039d0 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 -- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 msgr2=0x7fa3c0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3c0003de0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001800 tx=0x7fa3cc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 -- 172.21.15.110:0/3873509149 shutdown_connections 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 --2- 172.21.15.110:0/3873509149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3c0003de0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 -- 172.21.15.110:0/3873509149 >> 172.21.15.110:0/3873509149 conn(0x7fa3dc0cb9b0 msgr2=0x7fa3dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 -- 172.21.15.110:0/3873509149 shutdown_connections 2024-08-17T02:29:34.369 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.365+0000 7fa3e1800640 1 -- 172.21.15.110:0/3873509149 wait complete. 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.367+0000 7fa3e1800640 1 Processor -- start 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.367+0000 7fa3e1800640 1 -- start start 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3dc165af0 0x7fa3dc0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 0x7fa3dc12de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc1660f0 con 0x7fa3c00039d0 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c3bf0 con 0x7fa3dc12da00 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3e1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c3ed0 con 0x7fa3dc165af0 2024-08-17T02:29:34.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56714/0 (socket says 172.21.15.110:56714) 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 -- 172.21.15.110:0/2146411513 learned_addr learned my addr 172.21.15.110:0/2146411513 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3da000640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3dc165af0 0x7fa3dc0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3db400640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 0x7fa3dc12de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 -- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3dc165af0 msgr2=0x7fa3dc0a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3dc165af0 0x7fa3dc0a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 -- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 msgr2=0x7fa3dc12de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 0x7fa3dc12de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3daa00640 1 -- 172.21.15.110:0/2146411513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc0c41b0 con 0x7fa3c00039d0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.368+0000 7fa3db400640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 0x7fa3dc12de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3daa00640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001800 tx=0x7fa3cc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc007570 con 0x7fa3c00039d0 2024-08-17T02:29:34.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0076d0 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc0c4490 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0069e0 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.369+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc0c77d0 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.370+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc0c8700 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.371+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa3cc032600 con 0x7fa3c00039d0 2024-08-17T02:29:34.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.371+0000 7fa3d2000640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 0x7fa3bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.372+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa3cc0a1b90 con 0x7fa3c00039d0 2024-08-17T02:29:34.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.372+0000 7fa3da000640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 0x7fa3bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.372+0000 7fa3da000640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 0x7fa3bc067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000fd0 tx=0x7fa3c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.375+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa3dc0c8700 con 0x7fa3c00039d0 2024-08-17T02:29:34.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.554+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3dc0c8700 con 0x7fa3c00039d0 2024-08-17T02:29:34.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.555+0000 7fa3d2000640 1 -- 172.21.15.110:0/2146411513 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fa3dc0c8700 con 0x7fa3c00039d0 2024-08-17T02:29:34.556 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:34.556 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 msgr2=0x7fa3bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 0x7fa3bc067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8000fd0 tx=0x7fa3c8009040 comp rx=0 tx=0).stop 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 msgr2=0x7fa3dc0a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc001800 tx=0x7fa3cc003000 comp rx=0 tx=0).stop 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 shutdown_connections 2024-08-17T02:29:34.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa3bc065150 0x7fa3bc067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3dc12da00 0x7fa3dc12de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3dc165af0 0x7fa3dc0a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 --2- 172.21.15.110:0/2146411513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c00039d0 0x7fa3dc0a54d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 >> 172.21.15.110:0/2146411513 conn(0x7fa3dc0cb9b0 msgr2=0x7fa3dc13eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 shutdown_connections 2024-08-17T02:29:34.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.557+0000 7fa3e1800640 1 -- 172.21.15.110:0/2146411513 wait complete. 2024-08-17T02:29:34.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:34.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:34.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.724+0000 7fe2dda00640 1 Processor -- start 2024-08-17T02:29:34.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.724+0000 7fe2dda00640 1 -- start start 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2dda00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2d8158ed0 0x7fe2d8069a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2dda00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d81592a0 0x7fe2d80abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2dda00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80b10e0 con 0x7fe2d8096a70 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2dda00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80ac3f0 con 0x7fe2d8158ed0 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2dda00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80ac680 con 0x7fe2d81592a0 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2d7400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe2d8096a70 0x7fe2d8067d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57474/0 (socket says 172.21.15.110:57474) 2024-08-17T02:29:34.727 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.725+0000 7fe2d7400640 1 -- 172.21.15.110:0/1489776901 learned_addr learned my addr 172.21.15.110:0/1489776901 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d6000640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d81592a0 0x7fe2d80abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/1489776901 >> v2:172.21.15.177:3300/0 conn(0x7fe2d8158ed0 0x7fe2d8069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274840767 0 0) 0x7fe2d80b10e0 con 0x7fe2d8096a70 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc0034e0 con 0x7fe2d8096a70 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517024330 0 0) 0x7fe2bc0034e0 con 0x7fe2d8096a70 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d81592a0 msgr2=0x7fe2d80abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d81592a0 0x7fe2d80abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 >> v2:172.21.15.177:3300/0 conn(0x7fe2d8158ed0 msgr2=0x7fe2d8069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 --2- 172.21.15.110:0/1489776901 >> v2:172.21.15.177:3300/0 conn(0x7fe2d8158ed0 0x7fe2d8069a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80b0a90 con 0x7fe2d8096a70 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fe2d00017f0 con 0x7fe2d8096a70 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 >> v1:172.21.15.110:6789/0 conn(0x7fe2d8096a70 legacy=0x7fe2d8067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2bc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc004780 0x7fe2bc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2bc005130 0x7fe2bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80ac3f0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80ac680 con 0x7fe2bc004780 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.726+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc0055e0 con 0x7fe2bc005130 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2bc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6000640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc004780 0x7fe2bc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d7400640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2bc005130 0x7fe2bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 -- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2bc005130 msgr2=0x7fe2bc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2bc005130 0x7fe2bc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 -- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc004780 msgr2=0x7fe2bc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:34.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2bc004780 0x7fe2bc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.727+0000 7fe2d6a00640 1 -- 172.21.15.110:0/1489776901 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0034e0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.728+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2bc003de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009b70 tx=0x7fe2c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dc78bf058768de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.728+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8031400 con 0x7fe2bc0039d0 2024-08-17T02:29:34.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.728+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c802d050 con 0x7fe2bc0039d0 2024-08-17T02:29:34.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.728+0000 7fe2d5600640 1 -- 172.21.15.110:0/1489776901 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8031790 con 0x7fe2bc0039d0 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 -- 172.21.15.110:0/1489776901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 msgr2=0x7fe2bc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 --2- 172.21.15.110:0/1489776901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2bc003de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009b70 tx=0x7fe2c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2d7400640 1 -- 172.21.15.110:0/1489776901 reap_dead start 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 -- 172.21.15.110:0/1489776901 shutdown_connections 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 -- 172.21.15.110:0/1489776901 >> 172.21.15.110:0/1489776901 conn(0x7fe2d80b30b0 msgr2=0x7fe2d80b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 -- 172.21.15.110:0/1489776901 shutdown_connections 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.729+0000 7fe2dda00640 1 -- 172.21.15.110:0/1489776901 wait complete. 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.730+0000 7fe2dda00640 1 Processor -- start 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 -- start start 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2d80afe70 0x7fe2d80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 0x7fe2d80cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d815a7a0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80af9e0 con 0x7fe2d80afe70 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.731+0000 7fe2dda00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80aeb50 con 0x7fe2d8151890 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56732/0 (socket says 172.21.15.110:56732) 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 -- 172.21.15.110:0/2125119462 learned_addr learned my addr 172.21.15.110:0/2125119462 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6000640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2d80afe70 0x7fe2d80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d7400640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 0x7fe2d80cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 -- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 msgr2=0x7fe2d80cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 0x7fe2d80cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 -- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2d80afe70 msgr2=0x7fe2d80ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2d80afe70 0x7fe2d80ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 -- 172.21.15.110:0/2125119462 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80aedd0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d7400640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 0x7fe2d80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.732+0000 7fe2d6a00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009bd0 tx=0x7fe2c8035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.733+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803b4f0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.733+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8040070 con 0x7fe2bc0039d0 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.733+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c803b8a0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.733+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80af0b0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.733+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80af670 con 0x7fe2bc0039d0 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.734+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d8064db0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.735+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe2c8042030 con 0x7fe2bc0039d0 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.736+0000 7fe2ce000640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.736+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe2c80a3490 con 0x7fe2bc0039d0 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.736+0000 7fe2d6000640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:34.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.736+0000 7fe2d6000640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 0x7fe2b8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d809bc00 tx=0x7fe2c40090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:34.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.740+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe2c8071550 con 0x7fe2bc0039d0 2024-08-17T02:29:34.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.911+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2d806c0d0 con 0x7fe2bc0039d0 2024-08-17T02:29:34.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.911+0000 7fe2ce000640 1 -- 172.21.15.110:0/2125119462 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2c8074b70 con 0x7fe2bc0039d0 2024-08-17T02:29:34.913 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.913+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 msgr2=0x7fe2b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.913+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 0x7fe2b8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d809bc00 tx=0x7fe2c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.913+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 msgr2=0x7fe2d815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.913+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009bd0 tx=0x7fe2c8035000 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 shutdown_connections 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2b8065150 0x7fe2b8067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2d8151890 0x7fe2d80cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2d80afe70 0x7fe2d80ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 --2- 172.21.15.110:0/2125119462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2bc0039d0 0x7fe2d815a260 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 >> 172.21.15.110:0/2125119462 conn(0x7fe2d80b30b0 msgr2=0x7fe2d80b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 shutdown_connections 2024-08-17T02:29:34.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:34.914+0000 7fe2dda00640 1 -- 172.21.15.110:0/2125119462 wait complete. 2024-08-17T02:29:34.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:35.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.079+0000 7f0231200640 1 Processor -- start 2024-08-17T02:29:35.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.079+0000 7f0231200640 1 -- start start 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f0231200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f022c156c50 0x7f022c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f0231200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f0231200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0ab130 con 0x7f022c0abb00 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f0231200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c0ae5a0 con 0x7f022c156c50 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f0231200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0ae2c0 con 0x7f022c0adcf0 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.080+0000 7f022a800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f022c0abb00 0x7f022c0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57486/0 (socket says 172.21.15.110:57486) 2024-08-17T02:29:35.082 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f022a800640 1 -- 172.21.15.110:0/664397082 learned_addr learned my addr 172.21.15.110:0/664397082 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229e00640 1 --2- 172.21.15.110:0/664397082 >> v2:172.21.15.177:3300/0 conn(0x7f022c156c50 0x7f022c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229400640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0228a00640 1 -- 172.21.15.110:0/664397082 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813972611 0 0) 0x7f022c0ab130 con 0x7f022c0abb00 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0228a00640 1 -- 172.21.15.110:0/664397082 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02100034e0 con 0x7f022c0abb00 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229e00640 1 -- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 msgr2=0x7f022c0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229e00640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229e00640 1 -- 172.21.15.110:0/664397082 >> v1:172.21.15.110:6789/0 conn(0x7f022c0abb00 legacy=0x7f022c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.081+0000 7f0229e00640 1 -- 172.21.15.110:0/664397082 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0aaae0 con 0x7f022c156c50 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.082+0000 7f0229e00640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c0c7cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f021c009850 tx=0x7f021c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d1718769a330b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0228a00640 1 -- 172.21.15.110:0/664397082 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c02ad00 con 0x7f022c156c50 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0228a00640 1 -- 172.21.15.110:0/664397082 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c02ae60 con 0x7f022c156c50 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0228a00640 1 -- 172.21.15.110:0/664397082 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c032650 con 0x7f022c156c50 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 -- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 msgr2=0x7f022c0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c0c7cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f021c009850 tx=0x7f021c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 -- 172.21.15.110:0/664397082 shutdown_connections 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 --2- 172.21.15.110:0/664397082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c0c7cf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 -- 172.21.15.110:0/664397082 >> 172.21.15.110:0/664397082 conn(0x7f022c067750 msgr2=0x7f022c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 -- 172.21.15.110:0/664397082 shutdown_connections 2024-08-17T02:29:35.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.083+0000 7f0231200640 1 -- 172.21.15.110:0/664397082 wait complete. 2024-08-17T02:29:35.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.085+0000 7f0231200640 1 Processor -- start 2024-08-17T02:29:35.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.085+0000 7f0231200640 1 -- start start 2024-08-17T02:29:35.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15d6b0 con 0x7f022c0abb00 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15cb30 con 0x7f022c156c50 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0231200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c15ce10 con 0x7f022c0adcf0 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56748/0 (socket says 172.21.15.110:56748) 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 -- 172.21.15.110:0/4124913774 learned_addr learned my addr 172.21.15.110:0/4124913774 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229400640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f022a800640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 -- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 msgr2=0x7f022c149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 -- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 msgr2=0x7f022c069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.086+0000 7f0229e00640 1 -- 172.21.15.110:0/4124913774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c009390 con 0x7f022c0abb00 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0229e00640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f021c009850 tx=0x7f021c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c03c680 con 0x7f022c0abb00 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c03c7e0 con 0x7f022c0abb00 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c03cb80 con 0x7f022c0abb00 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c15d0f0 con 0x7f022c0abb00 2024-08-17T02:29:35.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.087+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c15b7c0 con 0x7f022c0abb00 2024-08-17T02:29:35.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.088+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c071050 con 0x7f022c0abb00 2024-08-17T02:29:35.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.089+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f021c044030 con 0x7f022c0abb00 2024-08-17T02:29:35.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.090+0000 7f0221600640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.090+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f021c042070 con 0x7f022c0abb00 2024-08-17T02:29:35.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.090+0000 7f0229400640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.091+0000 7f0229400640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 0x7f020c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f022c069430 tx=0x7f02180090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.094+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f021c071290 con 0x7f022c0abb00 2024-08-17T02:29:35.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.264+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f022c14cf50 con 0x7f022c0abb00 2024-08-17T02:29:35.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.264+0000 7f0221600640 1 -- 172.21.15.110:0/4124913774 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f021c0370a0 con 0x7f022c0abb00 2024-08-17T02:29:35.266 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 msgr2=0x7f020c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 0x7f020c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f022c069430 tx=0x7f02180090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 msgr2=0x7f022c15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f021c009850 tx=0x7f021c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 shutdown_connections 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f020c065150 0x7f020c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f022c156c50 0x7f022c069810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f022c0adcf0 0x7f022c149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 --2- 172.21.15.110:0/4124913774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022c0abb00 0x7f022c15b280 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 >> 172.21.15.110:0/4124913774 conn(0x7f022c067750 msgr2=0x7f022c0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 shutdown_connections 2024-08-17T02:29:35.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.266+0000 7f0231200640 1 -- 172.21.15.110:0/4124913774 wait complete. 2024-08-17T02:29:35.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:35.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.431+0000 7f468ee00640 1 Processor -- start 2024-08-17T02:29:35.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.431+0000 7f468ee00640 1 -- start start 2024-08-17T02:29:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ee00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4688069a60 0x7f4688069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46880c7e50 0x7f468806a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ee00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468806d470 con 0x7f46880ab7f0 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ee00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880aec60 con 0x7f46880c7e50 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ee00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468806c860 con 0x7f4688069a60 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ce00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f46880ab7f0 0x7f4688154e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57490/0 (socket says 172.21.15.110:57490) 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f468ce00640 1 -- 172.21.15.110:0/2707648813 learned_addr learned my addr 172.21.15.110:0/2707648813 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f4687400640 1 --2- 172.21.15.110:0/2707648813 >> v2:172.21.15.110:3300/0 conn(0x7f46880c7e50 0x7f468806a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.435 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.433+0000 7f4687e00640 1 --2- 172.21.15.110:0/2707648813 >> v2:172.21.15.177:3300/0 conn(0x7f4688069a60 0x7f4688069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.434+0000 7f4687400640 1 -- 172.21.15.110:0/2707648813 >> v2:172.21.15.177:3300/0 conn(0x7f4688069a60 msgr2=0x7f4688069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.434+0000 7f4687400640 1 --2- 172.21.15.110:0/2707648813 >> v2:172.21.15.177:3300/0 conn(0x7f4688069a60 0x7f4688069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.434+0000 7f4687400640 1 -- 172.21.15.110:0/2707648813 >> v1:172.21.15.110:6789/0 conn(0x7f46880ab7f0 legacy=0x7f4688154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.434+0000 7f4687400640 1 -- 172.21.15.110:0/2707648813 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468806cb40 con 0x7f46880c7e50 2024-08-17T02:29:35.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.434+0000 7f4686a00640 1 -- 172.21.15.110:0/2707648813 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407851214 0 0) 0x7f468806d470 con 0x7f46880ab7f0 2024-08-17T02:29:35.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f4687400640 1 --2- 172.21.15.110:0/2707648813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46880c7e50 0x7f468806a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46880680f0 tx=0x7f46740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9572bef0eda87b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f4686a00640 1 -- 172.21.15.110:0/2707648813 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467402ad20 con 0x7f46880c7e50 2024-08-17T02:29:35.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f4686a00640 1 -- 172.21.15.110:0/2707648813 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467402ae80 con 0x7f46880c7e50 2024-08-17T02:29:35.437 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f4686a00640 1 -- 172.21.15.110:0/2707648813 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674032670 con 0x7f46880c7e50 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f468ee00640 1 -- 172.21.15.110:0/2707648813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46880c7e50 msgr2=0x7f468806a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f468ee00640 1 --2- 172.21.15.110:0/2707648813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46880c7e50 0x7f468806a590 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46880680f0 tx=0x7f46740090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f468ee00640 1 -- 172.21.15.110:0/2707648813 shutdown_connections 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f468ee00640 1 --2- 172.21.15.110:0/2707648813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46880c7e50 0x7f468806a590 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.435+0000 7f468ee00640 1 --2- 172.21.15.110:0/2707648813 >> v2:172.21.15.177:3300/0 conn(0x7f4688069a60 0x7f4688069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.436+0000 7f468ee00640 1 -- 172.21.15.110:0/2707648813 >> 172.21.15.110:0/2707648813 conn(0x7f4688067750 msgr2=0x7f46880c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.436+0000 7f468ee00640 1 -- 172.21.15.110:0/2707648813 shutdown_connections 2024-08-17T02:29:35.438 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.436+0000 7f468ee00640 1 -- 172.21.15.110:0/2707648813 wait complete. 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.437+0000 7f468ee00640 1 Processor -- start 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.437+0000 7f468ee00640 1 -- start start 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46880ab7f0 0x7f46881494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 0x7f46880abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4688168f00 con 0x7f4688069a60 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468814bee0 con 0x7f46880c7e50 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468814c2a0 con 0x7f46880ab7f0 2024-08-17T02:29:35.440 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f4687e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f4687e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56764/0 (socket says 172.21.15.110:56764) 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f4687e00640 1 -- 172.21.15.110:0/547562204 learned_addr learned my addr 172.21.15.110:0/547562204 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f468ce00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 0x7f46880abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.438+0000 7f4687400640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46880ab7f0 0x7f46881494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 -- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46880ab7f0 msgr2=0x7f46881494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46880ab7f0 0x7f46881494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 -- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 msgr2=0x7f46880abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 0x7f46880abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 -- 172.21.15.110:0/547562204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4674009390 con 0x7f4688069a60 2024-08-17T02:29:35.441 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f468ce00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 0x7f46880abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:35.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f4687e00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f467800e950 tx=0x7f467800a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800a700 con 0x7f4688069a60 2024-08-17T02:29:35.442 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800ca40 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468814b640 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800cde0 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.439+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468814bc00 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.440+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880ae1a0 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.441+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f46780113f0 con 0x7f4688069a60 2024-08-17T02:29:35.443 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.442+0000 7f467f400640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 0x7f4668067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.442+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4678015030 con 0x7f4688069a60 2024-08-17T02:29:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.442+0000 7f4687400640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 0x7f4668067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.444 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.443+0000 7f4687400640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 0x7f4668067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4674034000 tx=0x7f4674032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.447 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.446+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f46880ae1a0 con 0x7f4688069a60 2024-08-17T02:29:35.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.620+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46880ae1a0 con 0x7f4688069a60 2024-08-17T02:29:35.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.620+0000 7f467f400640 1 -- 172.21.15.110:0/547562204 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46880ae1a0 con 0x7f4688069a60 2024-08-17T02:29:35.622 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 msgr2=0x7f4668067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 0x7f4668067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4674034000 tx=0x7f4674032000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 msgr2=0x7f46881689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f467800e950 tx=0x7f467800a2b0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 shutdown_connections 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4668065150 0x7f4668067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46880c7e50 0x7f46880abc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46880ab7f0 0x7f46881494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 --2- 172.21.15.110:0/547562204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4688069a60 0x7f46881689c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 >> 172.21.15.110:0/547562204 conn(0x7f4688067750 msgr2=0x7f46880c8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 shutdown_connections 2024-08-17T02:29:35.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.622+0000 7f468ee00640 1 -- 172.21.15.110:0/547562204 wait complete. 2024-08-17T02:29:35.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:35.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.784+0000 7fc71be00640 1 Processor -- start 2024-08-17T02:29:35.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.784+0000 7fc71be00640 1 -- start start 2024-08-17T02:29:35.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc71be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ad0 0x7fc71c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc71be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc71c158ea0 0x7fc71c0ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc71be00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71c067d60 con 0x7fc71c0af410 2024-08-17T02:29:35.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc71be00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71c068600 con 0x7fc71c158ea0 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc71be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0aff70 con 0x7fc71c158ad0 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc712000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc71c158ea0 0x7fc71c0ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc712000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc71c158ea0 0x7fc71c0ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56778/0 (socket says 172.21.15.110:56778) 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.785+0000 7fc712000640 1 -- 172.21.15.110:0/4217695746 learned_addr learned my addr 172.21.15.110:0/4217695746 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.786+0000 7fc71aa00640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ad0 0x7fc71c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.786+0000 7fc712000640 1 -- 172.21.15.110:0/4217695746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ad0 msgr2=0x7fc71c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.786+0000 7fc712000640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ad0 0x7fc71c0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.786+0000 7fc712000640 1 -- 172.21.15.110:0/4217695746 >> v1:172.21.15.177:6789/0 conn(0x7fc71c0af410 legacy=0x7fc71c0af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:35.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.786+0000 7fc712000640 1 -- 172.21.15.110:0/4217695746 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0b01d0 con 0x7fc71c158ea0 2024-08-17T02:29:35.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.787+0000 7fc712000640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c158ea0 0x7fc71c0ac5b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc704009910 tx=0x7fc7040091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f496f66573bcf6dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.787+0000 7fc71a000640 1 -- 172.21.15.110:0/4217695746 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70402ad20 con 0x7fc71c158ea0 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.787+0000 7fc71a000640 1 -- 172.21.15.110:0/4217695746 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70402ae80 con 0x7fc71c158ea0 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.787+0000 7fc71a000640 1 -- 172.21.15.110:0/4217695746 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc704032670 con 0x7fc71c158ea0 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 -- 172.21.15.110:0/4217695746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c158ea0 msgr2=0x7fc71c0ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c158ea0 0x7fc71c0ac5b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc704009910 tx=0x7fc7040091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 -- 172.21.15.110:0/4217695746 shutdown_connections 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c158ea0 0x7fc71c0ac5b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 --2- 172.21.15.110:0/4217695746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ad0 0x7fc71c0ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 -- 172.21.15.110:0/4217695746 >> 172.21.15.110:0/4217695746 conn(0x7fc71c096a70 msgr2=0x7fc71c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 -- 172.21.15.110:0/4217695746 shutdown_connections 2024-08-17T02:29:35.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.788+0000 7fc71be00640 1 -- 172.21.15.110:0/4217695746 wait complete. 2024-08-17T02:29:35.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.789+0000 7fc71be00640 1 Processor -- start 2024-08-17T02:29:35.791 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.789+0000 7fc71be00640 1 -- start start 2024-08-17T02:29:35.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 0x7fc71c16c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ea0 0x7fc71c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c1693c0 con 0x7fc71c0af410 2024-08-17T02:29:35.793 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c16cbb0 con 0x7fc71c158ad0 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c169070 con 0x7fc71c158ea0 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.790+0000 7fc71aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56784/0 (socket says 172.21.15.110:56784) 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 -- 172.21.15.110:0/1595303741 learned_addr learned my addr 172.21.15.110:0/1595303741 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71b400640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ea0 0x7fc71c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc712000640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 0x7fc71c16c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 -- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ea0 msgr2=0x7fc71c153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ea0 0x7fc71c153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 -- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 msgr2=0x7fc71c16c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 0x7fc71c16c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 -- 172.21.15.110:0/1595303741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc704009450 con 0x7fc71c0af410 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc712000640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 0x7fc71c16c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc71aa00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00d890 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00de20 con 0x7fc71c0af410 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c0098b0 con 0x7fc71c0af410 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.791+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c009c50 con 0x7fc71c0af410 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.792+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c16ce30 con 0x7fc71c0af410 2024-08-17T02:29:35.795 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.792+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c16d3f0 con 0x7fc71c0af410 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.793+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c071050 con 0x7fc71c0af410 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.793+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc70c014620 con 0x7fc71c0af410 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.794+0000 7fc712a00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 0x7fc6f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.794+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc70c082ca0 con 0x7fc71c0af410 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.794+0000 7fc712000640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 0x7fc6f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:35.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.795+0000 7fc712000640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 0x7fc6f8067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc704034000 tx=0x7fc704032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:35.800 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.799+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc70c050cc0 con 0x7fc71c0af410 2024-08-17T02:29:35.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.974+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc71c06add0 con 0x7fc71c0af410 2024-08-17T02:29:35.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.975+0000 7fc712a00640 1 -- 172.21.15.110:0/1595303741 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fc70c0542e0 con 0x7fc71c0af410 2024-08-17T02:29:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:35.977 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:35.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 msgr2=0x7fc6f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 0x7fc6f8067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc704034000 tx=0x7fc704032000 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 msgr2=0x7fc71c0b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00d890 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 shutdown_connections 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc6f8065150 0x7fc6f8067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71c158ea0 0x7fc71c153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc71c158ad0 0x7fc71c16c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 --2- 172.21.15.110:0/1595303741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71c0af410 0x7fc71c0b2960 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 >> 172.21.15.110:0/1595303741 conn(0x7fc71c096a70 msgr2=0x7fc71c0ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 shutdown_connections 2024-08-17T02:29:35.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:35.977+0000 7fc71be00640 1 -- 172.21.15.110:0/1595303741 wait complete. 2024-08-17T02:29:35.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:35.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:36.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.144+0000 7f94d8a00640 1 Processor -- start 2024-08-17T02:29:36.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.144+0000 7f94d8a00640 1 -- start start 2024-08-17T02:29:36.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d8a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d40ac290 0x7f94d40ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 0x7f94d4069170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d8a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d40aed20 con 0x7f94d40aa730 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d8a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d40ae460 con 0x7f94d40ac290 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d8a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d40acba0 con 0x7f94d4068d40 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d40ac290 0x7f94d40ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d40ac290 0x7f94d40ac660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56800/0 (socket says 172.21.15.110:56800) 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.145+0000 7f94d3400640 1 -- 172.21.15.110:0/3472483072 learned_addr learned my addr 172.21.15.110:0/3472483072 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94caa00640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 0x7f94d4069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94d3400640 1 -- 172.21.15.110:0/3472483072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 msgr2=0x7f94d4069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94d3400640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 0x7f94d4069170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94d3400640 1 -- 172.21.15.110:0/3472483072 >> v1:172.21.15.177:6789/0 conn(0x7f94d40aa730 legacy=0x7f94d40aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94d3400640 1 -- 172.21.15.110:0/3472483072 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4069aa0 con 0x7f94d40ac290 2024-08-17T02:29:36.148 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.146+0000 7f94caa00640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 0x7f94d4069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:36.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d3400640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d40ac660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009910 tx=0x7f94c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f8ee1ce3cf0e45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.149 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d2a00640 1 -- 172.21.15.110:0/3472483072 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c402adb0 con 0x7f94d40ac290 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d2a00640 1 -- 172.21.15.110:0/3472483072 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4032440 con 0x7f94d40ac290 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d2a00640 1 -- 172.21.15.110:0/3472483072 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c4032820 con 0x7f94d40ac290 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d8a00640 1 -- 172.21.15.110:0/3472483072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 msgr2=0x7f94d40ac660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.147+0000 7f94d8a00640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d40ac660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009910 tx=0x7f94c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 -- 172.21.15.110:0/3472483072 shutdown_connections 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d4068d40 0x7f94d4069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 --2- 172.21.15.110:0/3472483072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d40ac660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 -- 172.21.15.110:0/3472483072 >> 172.21.15.110:0/3472483072 conn(0x7f94d4096a70 msgr2=0x7f94d4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 -- 172.21.15.110:0/3472483072 shutdown_connections 2024-08-17T02:29:36.150 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.148+0000 7f94d8a00640 1 -- 172.21.15.110:0/3472483072 wait complete. 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.149+0000 7f94d8a00640 1 Processor -- start 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.149+0000 7f94d8a00640 1 -- start start 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d4068d40 0x7f94d409b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d40aa730 0x7f94d40981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d4157a30 con 0x7f94d40ac290 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d409a2c0 con 0x7f94d4068d40 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d8a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d409a5a0 con 0x7f94d40aa730 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56802/0 (socket says 172.21.15.110:56802) 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d3e00640 1 -- 172.21.15.110:0/512076384 learned_addr learned my addr 172.21.15.110:0/512076384 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94caa00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d40aa730 0x7f94d40981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.150+0000 7f94d3400640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d4068d40 0x7f94d409b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 -- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d40aa730 msgr2=0x7f94d40981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d40aa730 0x7f94d40981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 -- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d4068d40 msgr2=0x7f94d409b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d4068d40 0x7f94d409b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 -- 172.21.15.110:0/512076384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4009450 con 0x7f94d40ac290 2024-08-17T02:29:36.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d3e00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c890 tx=0x7f94cc002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00ce80 con 0x7f94d40ac290 2024-08-17T02:29:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc00a7f0 con 0x7f94d40ac290 2024-08-17T02:29:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.151+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d409a880 con 0x7f94d40ac290 2024-08-17T02:29:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.152+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc00abf0 con 0x7f94d40ac290 2024-08-17T02:29:36.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.152+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d4098720 con 0x7f94d40ac290 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.153+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d4071050 con 0x7f94d40ac290 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.153+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f94cc00ad50 con 0x7f94d40ac290 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.154+0000 7f94cb400640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 0x7f94b00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.154+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94cc082670 con 0x7f94d40ac290 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.154+0000 7f94d3400640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 0x7f94b00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.155+0000 7f94d3400640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 0x7f94b00676d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94c4034000 tx=0x7f94c4032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.158+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f94cc0507c0 con 0x7f94d40ac290 2024-08-17T02:29:36.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.330+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94d40cd410 con 0x7f94d40ac290 2024-08-17T02:29:36.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.330+0000 7f94cb400640 1 -- 172.21.15.110:0/512076384 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94cc053de0 con 0x7f94d40ac290 2024-08-17T02:29:36.332 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 msgr2=0x7f94b00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 0x7f94b00676d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f94c4034000 tx=0x7f94c4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 msgr2=0x7f94d415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00c890 tx=0x7f94cc002640 comp rx=0 tx=0).stop 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 shutdown_connections 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f94b0065220 0x7f94b00676d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d40ac290 0x7f94d415b620 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d40aa730 0x7f94d40981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 --2- 172.21.15.110:0/512076384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d4068d40 0x7f94d409b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 >> 172.21.15.110:0/512076384 conn(0x7f94d4096a70 msgr2=0x7f94d40af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 shutdown_connections 2024-08-17T02:29:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.332+0000 7f94d8a00640 1 -- 172.21.15.110:0/512076384 wait complete. 2024-08-17T02:29:36.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:36.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.497+0000 7f7dbf200640 1 Processor -- start 2024-08-17T02:29:36.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.498+0000 7f7dbf200640 1 -- start start 2024-08-17T02:29:36.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 0x7f7dc0069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbf200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc00ae3a0 con 0x7f7dc0096e70 2024-08-17T02:29:36.500 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbf200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc00ac770 con 0x7f7dc00aeb60 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00ad010 con 0x7f7dc0069230 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7db5400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7dc0096e70 0x7f7dc00abfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57492/0 (socket says 172.21.15.110:57492) 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7db5400640 1 -- 172.21.15.110:0/2171074743 learned_addr learned my addr 172.21.15.110:0/2171074743 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbde00640 1 --2- 172.21.15.110:0/2171074743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 0x7f7dc0069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.499+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131653178 0 0) 0x7f7dc00ae3a0 con 0x7f7dc0096e70 2024-08-17T02:29:36.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.500+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7da40034e0 con 0x7f7dc0096e70 2024-08-17T02:29:36.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.500+0000 7f7dbde00640 1 -- 172.21.15.110:0/2171074743 >> v1:172.21.15.177:6789/0 conn(0x7f7dc00aeb60 legacy=0x7f7dc00aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.500+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554938026 0 0) 0x7f7dc00ac770 con 0x7f7dc00aeb60 2024-08-17T02:29:36.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.500+0000 7f7dbde00640 1 -- 172.21.15.110:0/2171074743 >> v1:172.21.15.110:6789/0 conn(0x7f7dc0096e70 legacy=0x7f7dc00abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.502 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.500+0000 7f7dbde00640 1 -- 172.21.15.110:0/2171074743 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00aca50 con 0x7f7dc0069230 2024-08-17T02:29:36.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbde00640 1 --2- 172.21.15.110:0/2171074743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 0x7f7dc0069600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009880 tx=0x7f7db00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a0dbb172eb68ead server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db002ace0 con 0x7f7dc0069230 2024-08-17T02:29:36.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db002ae40 con 0x7f7dc0069230 2024-08-17T02:29:36.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbd400640 1 -- 172.21.15.110:0/2171074743 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db0032670 con 0x7f7dc0069230 2024-08-17T02:29:36.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbf200640 1 -- 172.21.15.110:0/2171074743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 msgr2=0x7f7dc0069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.501+0000 7f7dbf200640 1 --2- 172.21.15.110:0/2171074743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 0x7f7dc0069600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009880 tx=0x7f7db00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.502+0000 7f7dbf200640 1 -- 172.21.15.110:0/2171074743 shutdown_connections 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.502+0000 7f7dbf200640 1 --2- 172.21.15.110:0/2171074743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0069230 0x7f7dc0069600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.502+0000 7f7dbf200640 1 -- 172.21.15.110:0/2171074743 >> 172.21.15.110:0/2171074743 conn(0x7f7dc0096a70 msgr2=0x7f7dc00cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.502+0000 7f7dbf200640 1 -- 172.21.15.110:0/2171074743 shutdown_connections 2024-08-17T02:29:36.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.502+0000 7f7dbf200640 1 -- 172.21.15.110:0/2171074743 wait complete. 2024-08-17T02:29:36.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.503+0000 7f7dbf200640 1 Processor -- start 2024-08-17T02:29:36.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.503+0000 7f7dbf200640 1 -- start start 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc0069230 0x7f7dc0156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0096e70 0x7f7dc01527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0155c80 con 0x7f7dc00aeb60 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0155070 con 0x7f7dc0069230 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0155350 con 0x7f7dc0096e70 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbe800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7db5400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0096e70 0x7f7dc01527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc0069230 0x7f7dc0156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbe800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56818/0 (socket says 172.21.15.110:56818) 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.504+0000 7f7dbe800640 1 -- 172.21.15.110:0/3016735004 learned_addr learned my addr 172.21.15.110:0/3016735004 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 -- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0096e70 msgr2=0x7f7dc01527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0096e70 0x7f7dc01527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 -- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc0069230 msgr2=0x7f7dc0156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc0069230 0x7f7dc0156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 -- 172.21.15.110:0/3016735004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db0009390 con 0x7f7dc00aeb60 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbe800640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7db8001560 tx=0x7f7db80016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800a7f0 con 0x7f7dc00aeb60 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800a950 con 0x7f7dc00aeb60 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc0155630 con 0x7f7dc00aeb60 2024-08-17T02:29:36.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.505+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800ad10 con 0x7f7dc00aeb60 2024-08-17T02:29:36.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.506+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc0156650 con 0x7f7dc00aeb60 2024-08-17T02:29:36.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.506+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc0071050 con 0x7f7dc00aeb60 2024-08-17T02:29:36.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.507+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7db8003030 con 0x7f7dc00aeb60 2024-08-17T02:29:36.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.508+0000 7f7db6000640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 0x7f7d9c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.508+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7db8082490 con 0x7f7dc00aeb60 2024-08-17T02:29:36.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.508+0000 7f7dbde00640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 0x7f7d9c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.510 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.509+0000 7f7dbde00640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 0x7f7d9c067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7db0034000 tx=0x7f7db0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.512+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7db8050560 con 0x7f7dc00aeb60 2024-08-17T02:29:36.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.684+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7dc0158b80 con 0x7f7dc00aeb60 2024-08-17T02:29:36.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.685+0000 7f7db6000640 1 -- 172.21.15.110:0/3016735004 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7db8053b80 con 0x7f7dc00aeb60 2024-08-17T02:29:36.686 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 msgr2=0x7f7d9c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 0x7f7d9c067630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7db0034000 tx=0x7f7db0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 msgr2=0x7f7dc0098110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7db8001560 tx=0x7f7db80016c0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 shutdown_connections 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7d9c065180 0x7f7d9c067630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dc00aeb60 0x7f7dc0098110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dc0096e70 0x7f7dc01527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 --2- 172.21.15.110:0/3016735004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dc0069230 0x7f7dc0156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 >> 172.21.15.110:0/3016735004 conn(0x7f7dc0096a70 msgr2=0x7f7dc00ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 shutdown_connections 2024-08-17T02:29:36.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.687+0000 7f7dbf200640 1 -- 172.21.15.110:0/3016735004 wait complete. 2024-08-17T02:29:36.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:36.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.857+0000 7f22d7c00640 1 Processor -- start 2024-08-17T02:29:36.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.857+0000 7f22d7c00640 1 -- start start 2024-08-17T02:29:36.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d7c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22d00c92e0 0x7f22d0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d7c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d01598f0 con 0x7f22d0155a80 2024-08-17T02:29:36.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d7c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d0159bd0 con 0x7f22d00c7db0 2024-08-17T02:29:36.860 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d7c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d0159eb0 con 0x7f22d00c92e0 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d5200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f22d0155a80 0x7f22d006dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57508/0 (socket says 172.21.15.110:57508) 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d5200640 1 -- 172.21.15.110:0/2647228226 learned_addr learned my addr 172.21.15.110:0/2647228226 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22d5c00640 1 --2- 172.21.15.110:0/2647228226 >> v2:172.21.15.110:3300/0 conn(0x7f22d00c92e0 0x7f22d0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.859+0000 7f22cfe00640 1 -- 172.21.15.110:0/2647228226 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399894170 0 0) 0x7f22d01598f0 con 0x7f22d0155a80 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.860+0000 7f22d5c00640 1 -- 172.21.15.110:0/2647228226 >> v1:172.21.15.177:6789/0 conn(0x7f22d00c7db0 legacy=0x7f22d00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.860+0000 7f22d5c00640 1 -- 172.21.15.110:0/2647228226 >> v1:172.21.15.110:6789/0 conn(0x7f22d0155a80 legacy=0x7f22d006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.860+0000 7f22d5c00640 1 -- 172.21.15.110:0/2647228226 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d015a190 con 0x7f22d00c92e0 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d5c00640 1 --2- 172.21.15.110:0/2647228226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d0160b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009e60 tx=0x7f22c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f58020c38a52ee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22cfe00640 1 -- 172.21.15.110:0/2647228226 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8030550 con 0x7f22d00c92e0 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22cfe00640 1 -- 172.21.15.110:0/2647228226 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c80306b0 con 0x7f22d00c92e0 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22cfe00640 1 -- 172.21.15.110:0/2647228226 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8030a50 con 0x7f22d00c92e0 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d7c00640 1 -- 172.21.15.110:0/2647228226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 msgr2=0x7f22d0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d7c00640 1 --2- 172.21.15.110:0/2647228226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d0160b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009e60 tx=0x7f22c8009780 comp rx=0 tx=0).stop 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d7c00640 1 -- 172.21.15.110:0/2647228226 shutdown_connections 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d7c00640 1 --2- 172.21.15.110:0/2647228226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d0160b90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.861+0000 7f22d7c00640 1 -- 172.21.15.110:0/2647228226 >> 172.21.15.110:0/2647228226 conn(0x7f22d0067750 msgr2=0x7f22d00c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:36.863 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.862+0000 7f22d7c00640 1 -- 172.21.15.110:0/2647228226 shutdown_connections 2024-08-17T02:29:36.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.862+0000 7f22d7c00640 1 -- 172.21.15.110:0/2647228226 wait complete. 2024-08-17T02:29:36.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.863+0000 7f22d7c00640 1 Processor -- start 2024-08-17T02:29:36.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.863+0000 7f22d7c00640 1 -- start start 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d00c7db0 0x7f22d0153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22d0155a80 0x7f22d00ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0155e50 con 0x7f22d00c92e0 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0156410 con 0x7f22d00c7db0 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d7c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0154570 con 0x7f22d0155a80 2024-08-17T02:29:36.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22c7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d5200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d00c7db0 0x7f22d0153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22c7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56828/0 (socket says 172.21.15.110:56828) 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22c7e00640 1 -- 172.21.15.110:0/1503245173 learned_addr learned my addr 172.21.15.110:0/1503245173 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.864+0000 7f22d5c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22d0155a80 0x7f22d00ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 -- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22d0155a80 msgr2=0x7f22d00ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22d0155a80 0x7f22d00ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 -- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d00c7db0 msgr2=0x7f22d0153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d00c7db0 0x7f22d0153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 -- 172.21.15.110:0/1503245173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009a20 con 0x7f22d00c92e0 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22c7e00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c5c0 tx=0x7f22b8007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011590 con 0x7f22d00c92e0 2024-08-17T02:29:36.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8011710 con 0x7f22d00c92e0 2024-08-17T02:29:36.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d0154850 con 0x7f22d00c92e0 2024-08-17T02:29:36.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b8011ad0 con 0x7f22d00c92e0 2024-08-17T02:29:36.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.865+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d0159480 con 0x7f22d00c92e0 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.867+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d0071050 con 0x7f22d00c92e0 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.867+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f22b801b3b0 con 0x7f22d00c92e0 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.868+0000 7f22ccc00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 0x7f22ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.868+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22b8081950 con 0x7f22d00c92e0 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.868+0000 7f22d5200640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 0x7f22ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:36.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.869+0000 7f22d5200640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 0x7f22ac067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000c00 tx=0x7f22c0007ea0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:36.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:36.872+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22b804fa20 con 0x7f22d00c92e0 2024-08-17T02:29:37.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.042+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22d0156550 con 0x7f22d00c92e0 2024-08-17T02:29:37.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.042+0000 7f22ccc00640 1 -- 172.21.15.110:0/1503245173 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22b8017070 con 0x7f22d00c92e0 2024-08-17T02:29:37.044 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:37.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 msgr2=0x7f22ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 0x7f22ac067600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f22c0000c00 tx=0x7f22c0007ea0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 msgr2=0x7f22d00acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f22b800c5c0 tx=0x7f22b8007ec0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 shutdown_connections 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f22ac065150 0x7f22ac067600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.044+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22d0155a80 0x7f22d00ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.045+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22d00c92e0 0x7f22d00acb70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.045+0000 7f22d7c00640 1 --2- 172.21.15.110:0/1503245173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22d00c7db0 0x7f22d0153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.045+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 >> 172.21.15.110:0/1503245173 conn(0x7f22d0067750 msgr2=0x7f22d01515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.045+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 shutdown_connections 2024-08-17T02:29:37.047 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.045+0000 7f22d7c00640 1 -- 172.21.15.110:0/1503245173 wait complete. 2024-08-17T02:29:37.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:37.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.206+0000 7fbaad400640 1 Processor -- start 2024-08-17T02:29:37.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.206+0000 7fbaad400640 1 -- start start 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaad400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbaa80b1440 0x7fbaa80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaad400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fbaa80c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaad400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa80caa80 con 0x7fbaa81401b0 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaad400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa80cb450 con 0x7fbaa80b1440 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaad400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c9e70 con 0x7fbaa8140580 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaa6800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbaa81401b0 0x7fbaa80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57512/0 (socket says 172.21.15.110:57512) 2024-08-17T02:29:37.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaa6800640 1 -- 172.21.15.110:0/3025204098 learned_addr learned my addr 172.21.15.110:0/3025204098 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fbaa80c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fba9de00640 1 --2- 172.21.15.110:0/3025204098 >> v2:172.21.15.177:3300/0 conn(0x7fbaa80b1440 0x7fbaa80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960095556 0 0) 0x7fbaa80caa80 con 0x7fbaa81401b0 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.208+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba8c0034e0 con 0x7fbaa81401b0 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 840042151 0 0) 0x7fba8c0034e0 con 0x7fbaa81401b0 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 msgr2=0x7fbaa80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fbaa80c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 >> v2:172.21.15.177:3300/0 conn(0x7fbaa80b1440 msgr2=0x7fbaa80caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 --2- 172.21.15.110:0/3025204098 >> v2:172.21.15.177:3300/0 conn(0x7fbaa80b1440 0x7fbaa80caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80ca150 con 0x7fbaa81401b0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fba98001470 con 0x7fbaa81401b0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 >> v1:172.21.15.110:6789/0 conn(0x7fbaa81401b0 legacy=0x7fbaa80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fba8c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba8c004020 0x7fba8c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba8c004cc0 0x7fba8c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80cb450 con 0x7fba8c004cc0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80c9e70 con 0x7fba8c004020 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c00bad0 con 0x7fbaa8140580 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba8c004cc0 0x7fba8c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fba9de00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba8c004020 0x7fba8c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.209+0000 7fbaa6800640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fba8c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fbaa7200640 1 -- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 msgr2=0x7fba8c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaa8140580 0x7fba8c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fbaa7200640 1 -- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba8c004020 msgr2=0x7fba8c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba8c004020 0x7fba8c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fbaa7200640 1 -- 172.21.15.110:0/3025204098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c0034e0 con 0x7fba8c004cc0 2024-08-17T02:29:37.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.210+0000 7fba9de00640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba8c004020 0x7fba8c004780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba8c004cc0 0x7fba8c005130 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00094d0 tx=0x7fbaa000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5994a8c9f7598ae0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa002d070 con 0x7fba8c004cc0 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa000f040 con 0x7fba8c004cc0 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaa5e00640 1 -- 172.21.15.110:0/3025204098 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa0031660 con 0x7fba8c004cc0 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaad400640 1 -- 172.21.15.110:0/3025204098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba8c004cc0 msgr2=0x7fba8c005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaad400640 1 --2- 172.21.15.110:0/3025204098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba8c004cc0 0x7fba8c005130 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00094d0 tx=0x7fbaa000b040 comp rx=0 tx=0).stop 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaa7200640 1 -- 172.21.15.110:0/3025204098 reap_dead start 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaad400640 1 -- 172.21.15.110:0/3025204098 shutdown_connections 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.211+0000 7fbaad400640 1 -- 172.21.15.110:0/3025204098 >> 172.21.15.110:0/3025204098 conn(0x7fbaa80cb9b0 msgr2=0x7fbaa80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.212+0000 7fbaad400640 1 -- 172.21.15.110:0/3025204098 shutdown_connections 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.212+0000 7fbaad400640 1 -- 172.21.15.110:0/3025204098 wait complete. 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.213+0000 7fbaad400640 1 Processor -- start 2024-08-17T02:29:37.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.213+0000 7fbaad400640 1 -- start start 2024-08-17T02:29:37.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba8c004cc0 0x7fbaa813e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaa80af060 0x7fbaa815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa813eab0 con 0x7fbaa813e640 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa8168d60 con 0x7fbaa80af060 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaad400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa80af810 con 0x7fba8c004cc0 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fba9de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fba9de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56846/0 (socket says 172.21.15.110:56846) 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fba9de00640 1 -- 172.21.15.110:0/3953399385 learned_addr learned my addr 172.21.15.110:0/3953399385 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaa6800640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba8c004cc0 0x7fbaa813e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.214+0000 7fbaa7200640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaa80af060 0x7fbaa815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 -- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba8c004cc0 msgr2=0x7fbaa813e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba8c004cc0 0x7fbaa813e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 -- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaa80af060 msgr2=0x7fbaa815b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaa80af060 0x7fbaa815b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 -- 172.21.15.110:0/3953399385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa80afaf0 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9de00640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba90011d40 tx=0x7fba900090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000fec0 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90011e40 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa80afdd0 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90014670 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.215+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa80af4d0 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.216+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa8168f10 con 0x7fbaa813e640 2024-08-17T02:29:37.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.217+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fba90014a60 con 0x7fbaa813e640 2024-08-17T02:29:37.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.218+0000 7fba9ea00640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 0x7fba84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.218+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba90018070 con 0x7fbaa813e640 2024-08-17T02:29:37.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.218+0000 7fbaa6800640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 0x7fba84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.219+0000 7fbaa6800640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 0x7fba84067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba980015a0 tx=0x7fba98001dc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.223 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.222+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbaa8168f10 con 0x7fbaa813e640 2024-08-17T02:29:37.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.394+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa8168ed0 con 0x7fbaa813e640 2024-08-17T02:29:37.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.395+0000 7fba9ea00640 1 -- 172.21.15.110:0/3953399385 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fba90021020 con 0x7fbaa813e640 2024-08-17T02:29:37.397 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:37.397 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 msgr2=0x7fba84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 0x7fba84067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba980015a0 tx=0x7fba98001dc0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 msgr2=0x7fbaa80aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba90011d40 tx=0x7fba900090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 shutdown_connections 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fba84065150 0x7fba84067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaa80af060 0x7fbaa815b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbaa813e640 0x7fbaa80aeb20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 --2- 172.21.15.110:0/3953399385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba8c004cc0 0x7fbaa813e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 >> 172.21.15.110:0/3953399385 conn(0x7fbaa80cb9b0 msgr2=0x7fbaa80c1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 shutdown_connections 2024-08-17T02:29:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.397+0000 7fbaad400640 1 -- 172.21.15.110:0/3953399385 wait complete. 2024-08-17T02:29:37.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:37.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:37.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.571+0000 7fa22f200640 1 Processor -- start 2024-08-17T02:29:37.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.571+0000 7fa22f200640 1 -- start start 2024-08-17T02:29:37.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 0x7fa2300cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa230154770 0x7fa230157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 0x7fa23006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa230157eb0 con 0x7fa230154770 2024-08-17T02:29:37.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2300ca160 con 0x7fa2301543a0 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300ca440 con 0x7fa2300ae230 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa225400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa230154770 0x7fa230157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa225400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa230154770 0x7fa230157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56862/0 (socket says 172.21.15.110:56862) 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa225400640 1 -- 172.21.15.110:0/1224147805 learned_addr learned my addr 172.21.15.110:0/1224147805 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22e800640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 0x7fa23006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.572+0000 7fa22de00640 1 --2- 172.21.15.110:0/1224147805 >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 0x7fa2300cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa225400640 1 -- 172.21.15.110:0/1224147805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 msgr2=0x7fa23006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa225400640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 0x7fa23006dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa225400640 1 -- 172.21.15.110:0/1224147805 >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 msgr2=0x7fa2300cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa225400640 1 --2- 172.21.15.110:0/1224147805 >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 0x7fa2300cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa225400640 1 -- 172.21.15.110:0/1224147805 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300ca720 con 0x7fa230154770 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa22e800640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 0x7fa23006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:37.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.573+0000 7fa22de00640 1 --2- 172.21.15.110:0/1224147805 >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 0x7fa2300cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:37.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa225400640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa230154770 0x7fa230157970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa23006c3b0 tx=0x7fa2180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abeb7bbd327b406 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa22d400640 1 -- 172.21.15.110:0/1224147805 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21802add0 con 0x7fa230154770 2024-08-17T02:29:37.576 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa22d400640 1 -- 172.21.15.110:0/1224147805 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218032440 con 0x7fa230154770 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa22d400640 1 -- 172.21.15.110:0/1224147805 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218032820 con 0x7fa230154770 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa22f200640 1 -- 172.21.15.110:0/1224147805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa230154770 msgr2=0x7fa230157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.574+0000 7fa22f200640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa230154770 0x7fa230157970 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa23006c3b0 tx=0x7fa2180091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 -- 172.21.15.110:0/1224147805 shutdown_connections 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2300ae230 0x7fa23006dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 --2- 172.21.15.110:0/1224147805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa230154770 0x7fa230157970 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 --2- 172.21.15.110:0/1224147805 >> v2:172.21.15.177:3300/0 conn(0x7fa2301543a0 0x7fa2300cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 -- 172.21.15.110:0/1224147805 >> 172.21.15.110:0/1224147805 conn(0x7fa230067750 msgr2=0x7fa23006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 -- 172.21.15.110:0/1224147805 shutdown_connections 2024-08-17T02:29:37.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.575+0000 7fa22f200640 1 -- 172.21.15.110:0/1224147805 wait complete. 2024-08-17T02:29:37.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.576+0000 7fa22f200640 1 Processor -- start 2024-08-17T02:29:37.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.576+0000 7fa22f200640 1 -- start start 2024-08-17T02:29:37.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2301543a0 0x7fa23006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 0x7fa23006caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006d0e0 con 0x7fa2300ae230 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006d3c0 con 0x7fa230154770 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23006d6a0 con 0x7fa2301543a0 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56866/0 (socket says 172.21.15.110:56866) 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22de00640 1 -- 172.21.15.110:0/2266270614 learned_addr learned my addr 172.21.15.110:0/2266270614 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa225400640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2301543a0 0x7fa23006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.577+0000 7fa22e800640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 0x7fa23006caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 -- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2301543a0 msgr2=0x7fa23006c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2301543a0 0x7fa23006c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 -- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 msgr2=0x7fa23006caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 0x7fa23006caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 -- 172.21.15.110:0/2266270614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009450 con 0x7fa2300ae230 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22e800640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 0x7fa23006caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22de00640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d890 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000de20 con 0x7fa2300ae230 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200098b0 con 0x7fa2300ae230 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220009c50 con 0x7fa2300ae230 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23006d980 con 0x7fa2300ae230 2024-08-17T02:29:37.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.578+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300b0c10 con 0x7fa2300ae230 2024-08-17T02:29:37.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.579+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa230071050 con 0x7fa2300ae230 2024-08-17T02:29:37.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.580+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa220014620 con 0x7fa2300ae230 2024-08-17T02:29:37.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.581+0000 7fa226000640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.581+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa220082a00 con 0x7fa2300ae230 2024-08-17T02:29:37.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.581+0000 7fa225400640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.582+0000 7fa225400640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 0x7fa20c067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa218034000 tx=0x7fa218032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.585+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa220050a20 con 0x7fa2300ae230 2024-08-17T02:29:37.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.754+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2300b0f30 con 0x7fa2300ae230 2024-08-17T02:29:37.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.754+0000 7fa226000640 1 -- 172.21.15.110:0/2266270614 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa220054040 con 0x7fa2300ae230 2024-08-17T02:29:37.756 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 msgr2=0x7fa20c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 0x7fa20c067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa218034000 tx=0x7fa218032000 comp rx=0 tx=0).stop 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 msgr2=0x7fa2300b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d890 tx=0x7fa220008040 comp rx=0 tx=0).stop 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 shutdown_connections 2024-08-17T02:29:37.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa20c065150 0x7fa20c067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa230154770 0x7fa23006caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2301543a0 0x7fa23006c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.756+0000 7fa22f200640 1 --2- 172.21.15.110:0/2266270614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300ae230 0x7fa2300b06d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.757+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 >> 172.21.15.110:0/2266270614 conn(0x7fa230067750 msgr2=0x7fa230155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.757+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 shutdown_connections 2024-08-17T02:29:37.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.757+0000 7fa22f200640 1 -- 172.21.15.110:0/2266270614 wait complete. 2024-08-17T02:29:37.773 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:37.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.923+0000 7f0a5ea00640 1 Processor -- start 2024-08-17T02:29:37.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.923+0000 7f0a5ea00640 1 -- start start 2024-08-17T02:29:37.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.924+0000 7f0a5ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a580ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.924+0000 7f0a5ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a580aaf20 0x7f0a580ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.924+0000 7f0a5ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a580681f0 con 0x7f0a58159170 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580b08c0 con 0x7f0a580aaf20 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580aca00 con 0x7f0a58158da0 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a580aaf20 0x7f0a580ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a580aaf20 0x7f0a580ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56882/0 (socket says 172.21.15.110:56882) 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 -- 172.21.15.110:0/2600650225 learned_addr learned my addr 172.21.15.110:0/2600650225 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a57e00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a580ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 -- 172.21.15.110:0/2600650225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 msgr2=0x7f0a580ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a580ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 -- 172.21.15.110:0/2600650225 >> v1:172.21.15.177:6789/0 conn(0x7f0a58159170 legacy=0x7f0a580aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.925+0000 7f0a5ca00640 1 -- 172.21.15.110:0/2600650225 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580acce0 con 0x7f0a580aaf20 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.926+0000 7f0a5ca00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580ae7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009f20 tx=0x7f0a50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6a7d14a8cafc75 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.926+0000 7f0a57400640 1 -- 172.21.15.110:0/2600650225 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50031400 con 0x7f0a580aaf20 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a57400640 1 -- 172.21.15.110:0/2600650225 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5002d050 con 0x7f0a580aaf20 2024-08-17T02:29:37.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a57400640 1 -- 172.21.15.110:0/2600650225 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a500317d0 con 0x7f0a580aaf20 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 -- 172.21.15.110:0/2600650225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 msgr2=0x7f0a580ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580ae7b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009f20 tx=0x7f0a50009840 comp rx=0 tx=0).stop 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 -- 172.21.15.110:0/2600650225 shutdown_connections 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580ae7b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/2600650225 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a580ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 -- 172.21.15.110:0/2600650225 >> 172.21.15.110:0/2600650225 conn(0x7f0a58096a70 msgr2=0x7f0a58096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 -- 172.21.15.110:0/2600650225 shutdown_connections 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.927+0000 7f0a5ea00640 1 -- 172.21.15.110:0/2600650225 wait complete. 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.929+0000 7f0a5ea00640 1 Processor -- start 2024-08-17T02:29:37.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.929+0000 7f0a5ea00640 1 -- start start 2024-08-17T02:29:37.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a581531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5815b870 0x7f0a58153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580b39b0 con 0x7f0a580aaf20 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580ca120 con 0x7f0a5815b870 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815b3e0 con 0x7f0a58158da0 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56894/0 (socket says 172.21.15.110:56894) 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 -- 172.21.15.110:0/4007316402 learned_addr learned my addr 172.21.15.110:0/4007316402 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a4f400640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a581531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a5ca00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5815b870 0x7f0a58153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 -- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 msgr2=0x7f0a581531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a581531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 -- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5815b870 msgr2=0x7f0a58153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5815b870 0x7f0a58153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a57e00640 1 -- 172.21.15.110:0/4007316402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50009ae0 con 0x7f0a580aaf20 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.930+0000 7f0a4f400640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a581531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:37.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a57e00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800ea20 tx=0x7f0a480090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800ca10 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4800cb70 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580b36d0 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48013470 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.931+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5815b070 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.932+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58071050 con 0x7f0a580aaf20 2024-08-17T02:29:37.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.933+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a48013860 con 0x7f0a580aaf20 2024-08-17T02:29:37.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.934+0000 7f0a4fe00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 0x7f0a34067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:37.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.934+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a480828a0 con 0x7f0a580aaf20 2024-08-17T02:29:37.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.934+0000 7f0a4f400640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 0x7f0a34067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:37.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.934+0000 7f0a4f400640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 0x7f0a34067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a58159ce0 tx=0x7f0a40009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:37.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:37.937+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a48050a20 con 0x7f0a580aaf20 2024-08-17T02:29:38.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.109+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a58156570 con 0x7f0a580aaf20 2024-08-17T02:29:38.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.109+0000 7f0a4fe00640 1 -- 172.21.15.110:0/4007316402 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a48054040 con 0x7f0a580aaf20 2024-08-17T02:29:38.111 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:38.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 msgr2=0x7f0a34067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 0x7f0a34067600 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a58159ce0 tx=0x7f0a40009040 comp rx=0 tx=0).stop 2024-08-17T02:29:38.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 msgr2=0x7f0a580b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800ea20 tx=0x7f0a480090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 shutdown_connections 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a34065150 0x7f0a34067600 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a5815b870 0x7f0a58153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a58158da0 0x7f0a581531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.111+0000 7f0a5ea00640 1 --2- 172.21.15.110:0/4007316402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a580aaf20 0x7f0a580b3050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.112+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 >> 172.21.15.110:0/4007316402 conn(0x7f0a58096a70 msgr2=0x7f0a580af730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.112+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 shutdown_connections 2024-08-17T02:29:38.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.112+0000 7f0a5ea00640 1 -- 172.21.15.110:0/4007316402 wait complete. 2024-08-17T02:29:38.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:38.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.277+0000 7fe3fbe00640 1 Processor -- start 2024-08-17T02:29:38.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.277+0000 7fe3fbe00640 1 -- start start 2024-08-17T02:29:38.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3fc0adfb0 0x7fe3fc0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fbe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0afc40 con 0x7fe3fc155a30 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fbe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0af030 con 0x7fe3fc155660 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fbe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0af310 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fa000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3fc0adfb0 0x7fe3fc0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fb400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe3fc155a30 0x7fe3fc06dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57516/0 (socket says 172.21.15.110:57516) 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.278+0000 7fe3fb400640 1 -- 172.21.15.110:0/3591021483 learned_addr learned my addr 172.21.15.110:0/3591021483 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:38.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.279+0000 7fe3fa000640 1 -- 172.21.15.110:0/3591021483 >> v1:172.21.15.177:6789/0 conn(0x7fe3fc155660 legacy=0x7fe3fc0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.279+0000 7fe3fa000640 1 -- 172.21.15.110:0/3591021483 >> v1:172.21.15.110:6789/0 conn(0x7fe3fc155a30 legacy=0x7fe3fc06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.279+0000 7fe3fa000640 1 -- 172.21.15.110:0/3591021483 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0af5f0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.279+0000 7fe3f9600640 1 -- 172.21.15.110:0/3591021483 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268369395 0 0) 0x7fe3fc0afc40 con 0x7fe3fc155a30 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.280+0000 7fe3fa000640 1 --2- 172.21.15.110:0/3591021483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc0ae750 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009850 tx=0x7fe3e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7aa7649f1d16cb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.280+0000 7fe3f9600640 1 -- 172.21.15.110:0/3591021483 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e802ae20 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.280+0000 7fe3f9600640 1 -- 172.21.15.110:0/3591021483 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8032440 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.280+0000 7fe3f9600640 1 -- 172.21.15.110:0/3591021483 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80327e0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3591021483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 msgr2=0x7fe3fc0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3591021483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc0ae750 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009850 tx=0x7fe3e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3591021483 shutdown_connections 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3591021483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc0ae750 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3591021483 >> 172.21.15.110:0/3591021483 conn(0x7fe3fc066cd0 msgr2=0x7fe3fc0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3591021483 shutdown_connections 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.281+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3591021483 wait complete. 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.282+0000 7fe3fbe00640 1 Processor -- start 2024-08-17T02:29:38.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.282+0000 7fe3fbe00640 1 -- start start 2024-08-17T02:29:38.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc155660 0x7fe3fc156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc155a30 0x7fe3fc157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15a460 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15afa0 con 0x7fe3fc155a30 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3fbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15a670 con 0x7fe3fc155660 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3faa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56908/0 (socket says 172.21.15.110:56908) 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.283+0000 7fe3faa00640 1 -- 172.21.15.110:0/3541371803 learned_addr learned my addr 172.21.15.110:0/3541371803 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 -- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc155660 msgr2=0x7fe3fc156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc155660 0x7fe3fc156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 -- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc155a30 msgr2=0x7fe3fc157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc155a30 0x7fe3fc157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 -- 172.21.15.110:0/3541371803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009390 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3faa00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c560 tx=0x7fe3ec007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011590 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec011710 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011ad0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc15a950 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.284+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc141370 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.286+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc071050 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.286+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3ec01b3b0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.287+0000 7fe3f2000640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 0x7fe3dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.287+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3ec0819f0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.287+0000 7fe3fa000640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 0x7fe3dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.288+0000 7fe3fa000640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 0x7fe3dc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8034000 tx=0x7fe3e8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.291+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe3ec04fab0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.462+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3fc06c5f0 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.463+0000 7fe3f2000640 1 -- 172.21.15.110:0/3541371803 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3ec017070 con 0x7fe3fc0adfb0 2024-08-17T02:29:38.464 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:38.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 msgr2=0x7fe3dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 0x7fe3dc067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8034000 tx=0x7fe3e8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:38.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 msgr2=0x7fe3fc140e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec00c560 tx=0x7fe3ec007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 shutdown_connections 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe3dc065150 0x7fe3dc067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe3fc155a30 0x7fe3fc157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3fc155660 0x7fe3fc156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 --2- 172.21.15.110:0/3541371803 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3fc0adfb0 0x7fe3fc140e30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 >> 172.21.15.110:0/3541371803 conn(0x7fe3fc066cd0 msgr2=0x7fe3fc0ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 shutdown_connections 2024-08-17T02:29:38.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.465+0000 7fe3fbe00640 1 -- 172.21.15.110:0/3541371803 wait complete. 2024-08-17T02:29:38.482 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:38.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.629+0000 7fbcd1200640 1 Processor -- start 2024-08-17T02:29:38.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.629+0000 7fbcd1200640 1 -- start start 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcd1200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbccc0b1440 0x7fbccc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcd1200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 0x7fbccc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcd1200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbccc0caa80 con 0x7fbccc1401b0 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcd1200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0cb450 con 0x7fbccc0b1440 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcd1200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbccc0c9e70 con 0x7fbccc140580 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbccc0b1440 0x7fbccc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbccc0b1440 0x7fbccc0caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56914/0 (socket says 172.21.15.110:56914) 2024-08-17T02:29:38.633 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 -- 172.21.15.110:0/756268357 learned_addr learned my addr 172.21.15.110:0/756268357 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 -- 172.21.15.110:0/756268357 >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 msgr2=0x7fbccc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcca800640 1 --2- 172.21.15.110:0/756268357 >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 0x7fbccc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 --2- 172.21.15.110:0/756268357 >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 0x7fbccc0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 -- 172.21.15.110:0/756268357 >> v1:172.21.15.177:6789/0 conn(0x7fbccc1401b0 legacy=0x7fbccc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcc1400640 1 -- 172.21.15.110:0/756268357 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0ca150 con 0x7fbccc0b1440 2024-08-17T02:29:38.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.631+0000 7fbcca800640 1 --2- 172.21.15.110:0/756268357 >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 0x7fbccc0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.632+0000 7fbcc1400640 1 --2- 172.21.15.110:0/756268357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc0b1440 0x7fbccc0caf10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0ca9f0 tx=0x7fbcb40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8284b0ab20c4e3da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcc9400640 1 -- 172.21.15.110:0/756268357 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb402add0 con 0x7fbccc0b1440 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcc9400640 1 -- 172.21.15.110:0/756268357 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb4032440 con 0x7fbccc0b1440 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcc9400640 1 -- 172.21.15.110:0/756268357 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4032820 con 0x7fbccc0b1440 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 -- 172.21.15.110:0/756268357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc0b1440 msgr2=0x7fbccc0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 --2- 172.21.15.110:0/756268357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc0b1440 0x7fbccc0caf10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0ca9f0 tx=0x7fbcb40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 -- 172.21.15.110:0/756268357 shutdown_connections 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 --2- 172.21.15.110:0/756268357 >> v2:172.21.15.177:3300/0 conn(0x7fbccc140580 0x7fbccc0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 --2- 172.21.15.110:0/756268357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc0b1440 0x7fbccc0caf10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 -- 172.21.15.110:0/756268357 >> 172.21.15.110:0/756268357 conn(0x7fbccc0cb9b0 msgr2=0x7fbccc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 -- 172.21.15.110:0/756268357 shutdown_connections 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.633+0000 7fbcd1200640 1 -- 172.21.15.110:0/756268357 wait complete. 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.635+0000 7fbcd1200640 1 Processor -- start 2024-08-17T02:29:38.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.635+0000 7fbcd1200640 1 -- start start 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbccc0b1440 0x7fbccc15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbccc140580 0x7fbccc16c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc16a650 con 0x7fbccc1401b0 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc16a320 con 0x7fbccc140580 2024-08-17T02:29:38.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcd1200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbccc15b960 con 0x7fbccc0b1440 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56928/0 (socket says 172.21.15.110:56928) 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 -- 172.21.15.110:0/3868236720 learned_addr learned my addr 172.21.15.110:0/3868236720 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc9e00640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbccc0b1440 0x7fbccc15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcca800640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbccc140580 0x7fbccc16c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 -- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbccc0b1440 msgr2=0x7fbccc15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbccc0b1440 0x7fbccc15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 -- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbccc140580 msgr2=0x7fbccc16c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbccc140580 0x7fbccc16c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.636+0000 7fbcc1400640 1 -- 172.21.15.110:0/3868236720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4009450 con 0x7fbccc1401b0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcc1400640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4035040 tx=0x7fbcb4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4031de0 con 0x7fbccc1401b0 2024-08-17T02:29:38.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb403d420 con 0x7fbccc1401b0 2024-08-17T02:29:38.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb403d7e0 con 0x7fbccc1401b0 2024-08-17T02:29:38.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbccc15bc40 con 0x7fbccc1401b0 2024-08-17T02:29:38.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.637+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbccc15b4e0 con 0x7fbccc1401b0 2024-08-17T02:29:38.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.638+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc16a7c0 con 0x7fbccc1401b0 2024-08-17T02:29:38.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.639+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbcb4039040 con 0x7fbccc1401b0 2024-08-17T02:29:38.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.640+0000 7fbcc2000640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 0x7fbca8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.640+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcb40a24f0 con 0x7fbccc1401b0 2024-08-17T02:29:38.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.640+0000 7fbcc9e00640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 0x7fbca8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.641+0000 7fbcc9e00640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 0x7fbca8067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0b09f0 tx=0x7fbcbc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.644+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbcb40705b0 con 0x7fbccc1401b0 2024-08-17T02:29:38.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.816+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbccc15b6d0 con 0x7fbccc1401b0 2024-08-17T02:29:38.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.817+0000 7fbcc2000640 1 -- 172.21.15.110:0/3868236720 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbcb4073bd0 con 0x7fbccc1401b0 2024-08-17T02:29:38.819 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:38.819 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 msgr2=0x7fbca8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 0x7fbca8067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0b09f0 tx=0x7fbcbc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 msgr2=0x7fbccc16c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4035040 tx=0x7fbcb4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 shutdown_connections 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbca8065150 0x7fbca8067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbccc140580 0x7fbccc16c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbccc1401b0 0x7fbccc16c380 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 --2- 172.21.15.110:0/3868236720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbccc0b1440 0x7fbccc15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 >> 172.21.15.110:0/3868236720 conn(0x7fbccc0cb9b0 msgr2=0x7fbccc06db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 shutdown_connections 2024-08-17T02:29:38.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.819+0000 7fbcd1200640 1 -- 172.21.15.110:0/3868236720 wait complete. 2024-08-17T02:29:38.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:38.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:38.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.985+0000 7fa0be200640 1 Processor -- start 2024-08-17T02:29:38.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.985+0000 7fa0be200640 1 -- start start 2024-08-17T02:29:38.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 0x7fa0b80b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0b8157e10 0x7fa0b80ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0b80adcf0 0x7fa0b815a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80b1390 con 0x7fa0b80adcf0 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80ae150 con 0x7fa0b8157e10 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.986+0000 7fa0be200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8157070 con 0x7fa0b80b0a80 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0b80adcf0 0x7fa0b815a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa0b80adcf0 0x7fa0b815a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56938/0 (socket says 172.21.15.110:56938) 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 -- 172.21.15.110:0/1621205282 learned_addr learned my addr 172.21.15.110:0/1621205282 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b6a00640 1 --2- 172.21.15.110:0/1621205282 >> v2:172.21.15.177:3300/0 conn(0x7fa0b8157e10 0x7fa0b80ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 0x7fa0b80b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 -- 172.21.15.110:0/1621205282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 msgr2=0x7fa0b80b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 0x7fa0b80b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 -- 172.21.15.110:0/1621205282 >> v2:172.21.15.177:3300/0 conn(0x7fa0b8157e10 msgr2=0x7fa0b80ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:38.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 --2- 172.21.15.110:0/1621205282 >> v2:172.21.15.177:3300/0 conn(0x7fa0b8157e10 0x7fa0b80ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7e00640 1 -- 172.21.15.110:0/1621205282 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b815b410 con 0x7fa0b80adcf0 2024-08-17T02:29:38.990 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.987+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 0x7fa0b80b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.988+0000 7fa0b7e00640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80adcf0 0x7fa0b815a6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8068470 tx=0x7fa0b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffdbdc61777de89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.988+0000 7fa0b6000640 1 -- 172.21.15.110:0/1621205282 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0031400 con 0x7fa0b80adcf0 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.988+0000 7fa0b6000640 1 -- 172.21.15.110:0/1621205282 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b002d050 con 0x7fa0b80adcf0 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.988+0000 7fa0b6000640 1 -- 172.21.15.110:0/1621205282 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00317d0 con 0x7fa0b80adcf0 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 -- 172.21.15.110:0/1621205282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80adcf0 msgr2=0x7fa0b815a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80adcf0 0x7fa0b815a6e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8068470 tx=0x7fa0b0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:38.991 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 -- 172.21.15.110:0/1621205282 shutdown_connections 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80adcf0 0x7fa0b815a6e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 --2- 172.21.15.110:0/1621205282 >> v2:172.21.15.177:3300/0 conn(0x7fa0b8157e10 0x7fa0b80ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 --2- 172.21.15.110:0/1621205282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b80b0a80 0x7fa0b80b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 -- 172.21.15.110:0/1621205282 >> 172.21.15.110:0/1621205282 conn(0x7fa0b8067750 msgr2=0x7fa0b80cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 -- 172.21.15.110:0/1621205282 shutdown_connections 2024-08-17T02:29:38.992 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.989+0000 7fa0be200640 1 -- 172.21.15.110:0/1621205282 wait complete. 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.990+0000 7fa0be200640 1 Processor -- start 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.990+0000 7fa0be200640 1 -- start start 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 0x7fa0b813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 0x7fa0b80aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80aa9e0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80aca60 con 0x7fa0b80adcf0 2024-08-17T02:29:38.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.991+0000 7fa0be200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80ac130 con 0x7fa0b8157e10 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56948/0 (socket says 172.21.15.110:56948) 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 -- 172.21.15.110:0/1514664380 learned_addr learned my addr 172.21.15.110:0/1514664380 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 0x7fa0b813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 -- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 msgr2=0x7fa0b80aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b7e00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 0x7fa0b80aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 0x7fa0b80aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 -- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 msgr2=0x7fa0b813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 0x7fa0b813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 -- 172.21.15.110:0/1514664380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b0009ae0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 0x7fa0b813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b7e00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 0x7fa0b80aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:38.995 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0b6a00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400d890 tx=0x7fa0a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:38.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.992+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400de20 con 0x7fa0b80b0a80 2024-08-17T02:29:38.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.993+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a400b8d0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.993+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a400bc70 con 0x7fa0b80b0a80 2024-08-17T02:29:38.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.993+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b80ac410 con 0x7fa0b80b0a80 2024-08-17T02:29:38.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.993+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b813f8e0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.994+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b80abea0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.995+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa0a4014640 con 0x7fa0b80b0a80 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.995+0000 7fa0aea00640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 0x7fa098067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.995+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0a4082ac0 con 0x7fa0b80b0a80 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.996+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 0x7fa098067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:38.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.996+0000 7fa0b7400640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 0x7fa098067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8008a80 tx=0x7fa0a8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:38.999+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa0a4050ae0 con 0x7fa0b80b0a80 2024-08-17T02:29:39.172 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.171+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0b8064db0 con 0x7fa0b80b0a80 2024-08-17T02:29:39.173 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.171+0000 7fa0aea00640 1 -- 172.21.15.110:0/1514664380 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0a4054100 con 0x7fa0b80b0a80 2024-08-17T02:29:39.173 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 msgr2=0x7fa098067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 0x7fa098067630 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8008a80 tx=0x7fa0a8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 msgr2=0x7fa0b80acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa0a400d890 tx=0x7fa0a4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 shutdown_connections 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa098065180 0x7fa098067630 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0b8157e10 0x7fa0b80aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.175 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0b80b0a80 0x7fa0b80acef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 --2- 172.21.15.110:0/1514664380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0b80adcf0 0x7fa0b813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.173+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 >> 172.21.15.110:0/1514664380 conn(0x7fa0b8067750 msgr2=0x7fa0b8156320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.174+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 shutdown_connections 2024-08-17T02:29:39.176 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.174+0000 7fa0be200640 1 -- 172.21.15.110:0/1514664380 wait complete. 2024-08-17T02:29:39.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:39.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.338+0000 7f95c0c00640 1 Processor -- start 2024-08-17T02:29:39.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.338+0000 7f95c0c00640 1 -- start start 2024-08-17T02:29:39.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc155660 0x7f95bc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95bc0adfb0 0x7f95bc0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f95bc155a30 0x7f95bc06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0afc40 con 0x7f95bc0adfb0 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc0af030 con 0x7f95bc155a30 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95c0c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0af310 con 0x7f95bc155660 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95b2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95bc0adfb0 0x7f95bc0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95b2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95bc0adfb0 0x7f95bc0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56964/0 (socket says 172.21.15.110:56964) 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95b2a00640 1 -- 172.21.15.110:0/2450118544 learned_addr learned my addr 172.21.15.110:0/2450118544 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95bbe00640 1 --2- 172.21.15.110:0/2450118544 >> v2:172.21.15.177:3300/0 conn(0x7f95bc155a30 0x7f95bc06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.341 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.339+0000 7f95bb400640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc155660 0x7f95bc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.340+0000 7f95b2a00640 1 -- 172.21.15.110:0/2450118544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc155660 msgr2=0x7f95bc0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.340+0000 7f95b2a00640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc155660 0x7f95bc0c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.340+0000 7f95b2a00640 1 -- 172.21.15.110:0/2450118544 >> v2:172.21.15.177:3300/0 conn(0x7f95bc155a30 msgr2=0x7f95bc06dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.340+0000 7f95b2a00640 1 --2- 172.21.15.110:0/2450118544 >> v2:172.21.15.177:3300/0 conn(0x7f95bc155a30 0x7f95bc06dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.340+0000 7f95b2a00640 1 -- 172.21.15.110:0/2450118544 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0af5f0 con 0x7f95bc0adfb0 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95b2a00640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc0adfb0 0x7f95bc0ae750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0646c0 tx=0x7f95a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ba1149f6a5556b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95baa00640 1 -- 172.21.15.110:0/2450118544 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a402add0 con 0x7f95bc0adfb0 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95baa00640 1 -- 172.21.15.110:0/2450118544 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4032440 con 0x7f95bc0adfb0 2024-08-17T02:29:39.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95baa00640 1 -- 172.21.15.110:0/2450118544 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032820 con 0x7f95bc0adfb0 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 -- 172.21.15.110:0/2450118544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc0adfb0 msgr2=0x7f95bc0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc0adfb0 0x7f95bc0ae750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0646c0 tx=0x7f95a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 -- 172.21.15.110:0/2450118544 shutdown_connections 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 --2- 172.21.15.110:0/2450118544 >> v2:172.21.15.177:3300/0 conn(0x7f95bc155a30 0x7f95bc06dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc0adfb0 0x7f95bc0ae750 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 --2- 172.21.15.110:0/2450118544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc155660 0x7f95bc0c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.341+0000 7f95c0c00640 1 -- 172.21.15.110:0/2450118544 >> 172.21.15.110:0/2450118544 conn(0x7f95bc066cd0 msgr2=0x7f95bc0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.342+0000 7f95c0c00640 1 -- 172.21.15.110:0/2450118544 shutdown_connections 2024-08-17T02:29:39.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.342+0000 7f95c0c00640 1 -- 172.21.15.110:0/2450118544 wait complete. 2024-08-17T02:29:39.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.343+0000 7f95c0c00640 1 Processor -- start 2024-08-17T02:29:39.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.343+0000 7f95c0c00640 1 -- start start 2024-08-17T02:29:39.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc0adfb0 0x7f95bc0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc155a30 0x7f95bc0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc169670 con 0x7f95bc155660 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c77a0 con 0x7f95bc155a30 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95c0c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc152e50 con 0x7f95bc0adfb0 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56968/0 (socket says 172.21.15.110:56968) 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95b2a00640 1 -- 172.21.15.110:0/1167129771 learned_addr learned my addr 172.21.15.110:0/1167129771 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95bbe00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc155a30 0x7f95bc0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.344+0000 7f95bb400640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc0adfb0 0x7f95bc0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 -- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc0adfb0 msgr2=0x7f95bc0c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc0adfb0 0x7f95bc0c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 -- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc155a30 msgr2=0x7f95bc0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc155a30 0x7f95bc0c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 -- 172.21.15.110:0/1167129771 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009450 con 0x7f95bc155660 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b2a00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009210 tx=0x7f95a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031730 con 0x7f95bc155660 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a40318d0 con 0x7f95bc155660 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc153130 con 0x7f95bc155660 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031c90 con 0x7f95bc155660 2024-08-17T02:29:39.348 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.345+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1536f0 con 0x7f95bc155660 2024-08-17T02:29:39.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.346+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc1697e0 con 0x7f95bc155660 2024-08-17T02:29:39.349 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.347+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95a4043030 con 0x7f95bc155660 2024-08-17T02:29:39.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.348+0000 7f95b3400640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 0x7f9598067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.348+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95a4041070 con 0x7f95bc155660 2024-08-17T02:29:39.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.349+0000 7f95bb400640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 0x7f9598067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.350 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.349+0000 7f95bb400640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 0x7f9598067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009d20 tx=0x7f95ac0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.354 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.353+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95a4070c00 con 0x7f95bc155660 2024-08-17T02:29:39.525 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.524+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95bc071050 con 0x7f95bc155660 2024-08-17T02:29:39.526 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.524+0000 7f95b3400640 1 -- 172.21.15.110:0/1167129771 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95a404b0a0 con 0x7f95bc155660 2024-08-17T02:29:39.526 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 msgr2=0x7f9598067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 0x7f9598067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009d20 tx=0x7f95ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 msgr2=0x7f95bc1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009210 tx=0x7f95a4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 shutdown_connections 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9598065150 0x7f9598067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95bc155a30 0x7f95bc0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95bc155660 0x7f95bc1524e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 --2- 172.21.15.110:0/1167129771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95bc0adfb0 0x7f95bc0c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.526+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 >> 172.21.15.110:0/1167129771 conn(0x7f95bc066cd0 msgr2=0x7f95bc0caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.527+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 shutdown_connections 2024-08-17T02:29:39.529 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.527+0000 7f95c0c00640 1 -- 172.21.15.110:0/1167129771 wait complete. 2024-08-17T02:29:39.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:39.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.691+0000 7f48c3400640 1 Processor -- start 2024-08-17T02:29:39.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.691+0000 7f48c3400640 1 -- start start 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48c3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48bc0c8bd0 0x7f48bc0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48c3400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0ab130 con 0x7f48bc0adcf0 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48c3400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0c9530 con 0x7f48bc156c50 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48c3400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0ae5a0 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48c1400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f48bc0c8bd0 0x7f48bc0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48bbe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f48bc0adcf0 0x7f48bc0ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57520/0 (socket says 172.21.15.110:57520) 2024-08-17T02:29:39.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.692+0000 7f48bbe00640 1 -- 172.21.15.110:0/2151721622 learned_addr learned my addr 172.21.15.110:0/2151721622 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:39.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.693+0000 7f48c1400640 1 -- 172.21.15.110:0/2151721622 >> v1:172.21.15.177:6789/0 conn(0x7f48bc156c50 legacy=0x7f48bc0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:39.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.693+0000 7f48c1400640 1 -- 172.21.15.110:0/2151721622 >> v1:172.21.15.110:6789/0 conn(0x7f48bc0adcf0 legacy=0x7f48bc0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.693+0000 7f48c1400640 1 -- 172.21.15.110:0/2151721622 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0ae2c0 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.693+0000 7f48bb400640 1 -- 172.21.15.110:0/2151721622 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724634114 0 0) 0x7f48bc0ab130 con 0x7f48bc0adcf0 2024-08-17T02:29:39.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.694+0000 7f48c1400640 1 --2- 172.21.15.110:0/2151721622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0c8bd0 0x7f48bc0c8ff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009e60 tx=0x7f48b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4373978125f21a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.694+0000 7f48bb400640 1 -- 172.21.15.110:0/2151721622 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4007550 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.694+0000 7f48bb400640 1 -- 172.21.15.110:0/2151721622 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b402d050 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.694+0000 7f48bb400640 1 -- 172.21.15.110:0/2151721622 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b40078e0 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 -- 172.21.15.110:0/2151721622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0c8bd0 msgr2=0x7f48bc0c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 --2- 172.21.15.110:0/2151721622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0c8bd0 0x7f48bc0c8ff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009e60 tx=0x7f48b4009780 comp rx=0 tx=0).stop 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 -- 172.21.15.110:0/2151721622 shutdown_connections 2024-08-17T02:29:39.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 --2- 172.21.15.110:0/2151721622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc0c8bd0 0x7f48bc0c8ff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 -- 172.21.15.110:0/2151721622 >> 172.21.15.110:0/2151721622 conn(0x7f48bc067750 msgr2=0x7f48bc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 -- 172.21.15.110:0/2151721622 shutdown_connections 2024-08-17T02:29:39.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.695+0000 7f48c3400640 1 -- 172.21.15.110:0/2151721622 wait complete. 2024-08-17T02:29:39.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.696+0000 7f48c3400640 1 Processor -- start 2024-08-17T02:29:39.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.696+0000 7f48c3400640 1 -- start start 2024-08-17T02:29:39.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 0x7f48bc1483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 0x7f48bc1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc15a260 con 0x7f48bc156c50 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc159ca0 con 0x7f48bc0adcf0 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc159f80 con 0x7f48bc0c8bd0 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56990/0 (socket says 172.21.15.110:56990) 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.697+0000 7f48c1400640 1 -- 172.21.15.110:0/4148288935 learned_addr learned my addr 172.21.15.110:0/4148288935 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48bbe00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 0x7f48bc1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c0a00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 0x7f48bc1483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 -- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 msgr2=0x7f48bc1593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 0x7f48bc1593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 -- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 msgr2=0x7f48bc1483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 0x7f48bc1483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 -- 172.21.15.110:0/4148288935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009a20 con 0x7f48bc156c50 2024-08-17T02:29:39.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48bbe00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 0x7f48bc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:39.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c0a00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 0x7f48bc1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:39.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.698+0000 7f48c1400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48b40099f0 tx=0x7f48b4037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.699+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4007e40 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.699+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4040070 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.699+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4031e60 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.699+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc06c940 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.699+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc148900 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.700+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc06ce40 con 0x7f48bc156c50 2024-08-17T02:29:39.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.701+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f48b4042030 con 0x7f48bc156c50 2024-08-17T02:29:39.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.701+0000 7f48afe00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 0x7f489c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:39.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.701+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f48b40a3f70 con 0x7f48bc156c50 2024-08-17T02:29:39.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.702+0000 7f48c0a00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 0x7f489c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:39.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.702+0000 7f48c0a00640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 0x7f489c067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009970 tx=0x7f48b0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:39.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.705+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f48b4071f90 con 0x7f48bc156c50 2024-08-17T02:29:39.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.880+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48bc071050 con 0x7f48bc156c50 2024-08-17T02:29:39.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.881+0000 7f48afe00640 1 -- 172.21.15.110:0/4148288935 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48b40755b0 con 0x7f48bc156c50 2024-08-17T02:29:39.882 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 msgr2=0x7f489c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 0x7f489c067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f48b0009970 tx=0x7f48b0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 msgr2=0x7f48bc0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48b40099f0 tx=0x7f48b4037000 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 shutdown_connections 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f489c065150 0x7f489c067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48bc156c50 0x7f48bc0a98e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48bc0c8bd0 0x7f48bc1593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 --2- 172.21.15.110:0/4148288935 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48bc0adcf0 0x7f48bc1483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 >> 172.21.15.110:0/4148288935 conn(0x7f48bc067750 msgr2=0x7f48bc148de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:39.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 shutdown_connections 2024-08-17T02:29:39.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:39.883+0000 7f48c3400640 1 -- 172.21.15.110:0/4148288935 wait complete. 2024-08-17T02:29:39.961 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:29:39.961 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:29:39.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:40.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.107+0000 7fbb2cc00640 1 Processor -- start 2024-08-17T02:29:40.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.107+0000 7fbb2cc00640 1 -- start start 2024-08-17T02:29:40.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb2cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb280abb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb2cc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb28158e60 con 0x7fbb28157d30 2024-08-17T02:29:40.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb2cc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb28158530 con 0x7fbb28157250 2024-08-17T02:29:40.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb2cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28158810 con 0x7fbb2815a300 2024-08-17T02:29:40.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb26800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbb28157d30 0x7fbb280ac080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57524/0 (socket says 172.21.15.110:57524) 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.108+0000 7fbb26800640 1 -- 172.21.15.110:0/3667079616 learned_addr learned my addr 172.21.15.110:0/3667079616 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb1fe00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb280abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240221278 0 0) 0x7fbb28158e60 con 0x7fbb28157d30 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c0034e0 con 0x7fbb28157d30 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977672862 0 0) 0x7fbb0c0034e0 con 0x7fbb28157d30 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 msgr2=0x7fbb280abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb280abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 >> v1:172.21.15.177:6789/0 conn(0x7fbb28157250 legacy=0x7fbb28157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28158af0 con 0x7fbb28157d30 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fbb200017f0 con 0x7fbb28157d30 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 >> v1:172.21.15.110:6789/0 conn(0x7fbb28157d30 legacy=0x7fbb280ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb0c003a00 0x7fbb0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0c004780 0x7fbb0c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb0c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28158810 con 0x7fbb0c003a00 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c00bab0 con 0x7fbb0c004780 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.109+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c00bc70 con 0x7fbb2815a300 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb0c003a00 0x7fbb0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb1fe00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0c004780 0x7fbb0c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb26800640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb0c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 -- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 msgr2=0x7fbb0c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb2815a300 0x7fbb0c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 -- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0c004780 msgr2=0x7fbb0c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb0c004780 0x7fbb0c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.110+0000 7fbb25e00640 1 -- 172.21.15.110:0/3667079616 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0034e0 con 0x7fbb0c003a00 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.111+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb0c003a00 0x7fbb0c003dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001050 tx=0x7fbb18007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f78aa5bb815d25 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.111+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1802aa80 con 0x7fbb0c003a00 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.111+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1802ac00 con 0x7fbb0c003a00 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.111+0000 7fbb25400640 1 -- 172.21.15.110:0/3667079616 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180323f0 con 0x7fbb0c003a00 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3667079616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb0c003a00 msgr2=0x7fbb0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3667079616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb0c003a00 0x7fbb0c003dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbb18001050 tx=0x7fbb18007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb26800640 1 -- 172.21.15.110:0/3667079616 reap_dead start 2024-08-17T02:29:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3667079616 shutdown_connections 2024-08-17T02:29:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3667079616 >> 172.21.15.110:0/3667079616 conn(0x7fbb28096a70 msgr2=0x7fbb28096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3667079616 shutdown_connections 2024-08-17T02:29:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.112+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3667079616 wait complete. 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.113+0000 7fbb2cc00640 1 Processor -- start 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 -- start start 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb0c003a00 0x7fbb2815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 0x7fbb2815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b1120 con 0x7fbb280b3220 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2815b6c0 con 0x7fbb281679e0 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.114+0000 7fbb2cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2815b990 con 0x7fbb0c003a00 2024-08-17T02:29:40.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:56996/0 (socket says 172.21.15.110:56996) 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 -- 172.21.15.110:0/3163847864 learned_addr learned my addr 172.21.15.110:0/3163847864 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb1fe00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 0x7fbb2815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb0c003a00 0x7fbb2815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 -- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb0c003a00 msgr2=0x7fbb2815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb0c003a00 0x7fbb2815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 -- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 msgr2=0x7fbb2815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 0x7fbb2815b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 -- 172.21.15.110:0/3163847864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2815bc70 con 0x7fbb280b3220 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb1fe00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 0x7fbb2815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb26800640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb2809bc60 tx=0x7fbb20002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.115+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb200136d0 con 0x7fbb280b3220 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.116+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20013830 con 0x7fbb280b3220 2024-08-17T02:29:40.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.116+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280b0ad0 con 0x7fbb280b3220 2024-08-17T02:29:40.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.116+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20013bf0 con 0x7fbb280b3220 2024-08-17T02:29:40.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.116+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb280b3660 con 0x7fbb280b3220 2024-08-17T02:29:40.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.117+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb280b12d0 con 0x7fbb280b3220 2024-08-17T02:29:40.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.117+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb2001e460 con 0x7fbb280b3220 2024-08-17T02:29:40.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.118+0000 7fbb1d600640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 0x7fbb04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.118+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbb200825f0 con 0x7fbb280b3220 2024-08-17T02:29:40.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.119+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 0x7fbb04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.119+0000 7fbb25e00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 0x7fbb04067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb18032000 tx=0x7fbb18003000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.123+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb280b12d0 con 0x7fbb280b3220 2024-08-17T02:29:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.296+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb28064db0 con 0x7fbb280b3220 2024-08-17T02:29:40.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.296+0000 7fbb1d600640 1 -- 172.21.15.110:0/3163847864 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbb20050610 con 0x7fbb280b3220 2024-08-17T02:29:40.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:40.298 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:40.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 msgr2=0x7fbb04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 0x7fbb04067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb18032000 tx=0x7fbb18003000 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 msgr2=0x7fbb28169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbb2809bc60 tx=0x7fbb20002170 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 shutdown_connections 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbb04065150 0x7fbb04067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb280b3220 0x7fbb28169210 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb281679e0 0x7fbb2815b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 --2- 172.21.15.110:0/3163847864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb0c003a00 0x7fbb2815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 >> 172.21.15.110:0/3163847864 conn(0x7fbb28096a70 msgr2=0x7fbb28153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 shutdown_connections 2024-08-17T02:29:40.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.299+0000 7fbb2cc00640 1 -- 172.21.15.110:0/3163847864 wait complete. 2024-08-17T02:29:40.316 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:40.317 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:40.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.467+0000 7f521aa00640 1 Processor -- start 2024-08-17T02:29:40.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.467+0000 7f521aa00640 1 -- start start 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.468+0000 7f521aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f521406d9e0 0x7f521406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.468+0000 7f521aa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140c83e0 con 0x7f52140cb520 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.468+0000 7f521aa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140aed90 con 0x7f52140cb0c0 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.468+0000 7f521aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52140af070 con 0x7f521406d9e0 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.469+0000 7f5218a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f52140cb520 0x7f52140acc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57526/0 (socket says 172.21.15.110:57526) 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.469+0000 7f5218a00640 1 -- 172.21.15.110:0/409051701 learned_addr learned my addr 172.21.15.110:0/409051701 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.469+0000 7f5213e00640 1 --2- 172.21.15.110:0/409051701 >> v2:172.21.15.177:3300/0 conn(0x7f521406d9e0 0x7f521406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.469+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767120641 0 0) 0x7f52140c83e0 con 0x7f52140cb520 2024-08-17T02:29:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.470+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f80034e0 con 0x7f52140cb520 2024-08-17T02:29:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.470+0000 7f5213e00640 1 -- 172.21.15.110:0/409051701 >> v1:172.21.15.177:6789/0 conn(0x7f52140cb0c0 legacy=0x7f5214154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.470+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608394414 0 0) 0x7f52140aed90 con 0x7f52140cb0c0 2024-08-17T02:29:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.470+0000 7f5213e00640 1 -- 172.21.15.110:0/409051701 >> v1:172.21.15.110:6789/0 conn(0x7f52140cb520 legacy=0x7f52140acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.470+0000 7f5213e00640 1 -- 172.21.15.110:0/409051701 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140af350 con 0x7f521406d9e0 2024-08-17T02:29:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.471+0000 7f5213e00640 1 --2- 172.21.15.110:0/409051701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521406d9e0 0x7f521406ddb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5204009850 tx=0x7f52040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d7dc99704aa6bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.471+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520402ad00 con 0x7f521406d9e0 2024-08-17T02:29:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.471+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520402ae60 con 0x7f521406d9e0 2024-08-17T02:29:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.471+0000 7f5212a00640 1 -- 172.21.15.110:0/409051701 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204032650 con 0x7f521406d9e0 2024-08-17T02:29:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 -- 172.21.15.110:0/409051701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521406d9e0 msgr2=0x7f521406ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 --2- 172.21.15.110:0/409051701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521406d9e0 0x7f521406ddb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5204009850 tx=0x7f52040090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 -- 172.21.15.110:0/409051701 shutdown_connections 2024-08-17T02:29:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 --2- 172.21.15.110:0/409051701 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f521406d9e0 0x7f521406ddb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 -- 172.21.15.110:0/409051701 >> 172.21.15.110:0/409051701 conn(0x7f5214067750 msgr2=0x7f52140cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 -- 172.21.15.110:0/409051701 shutdown_connections 2024-08-17T02:29:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.472+0000 7f521aa00640 1 -- 172.21.15.110:0/409051701 wait complete. 2024-08-17T02:29:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.474+0000 7f521aa00640 1 Processor -- start 2024-08-17T02:29:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.474+0000 7f521aa00640 1 -- start start 2024-08-17T02:29:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52140cb0c0 0x7f52141697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 0x7f52140c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214069850 con 0x7f521406d9e0 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214153eb0 con 0x7f52140cb0c0 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f521aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5214169d20 con 0x7f52140cb520 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57012/0 (socket says 172.21.15.110:57012) 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 -- 172.21.15.110:0/1082149726 learned_addr learned my addr 172.21.15.110:0/1082149726 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5218a00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 0x7f52140c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213400640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52140cb0c0 0x7f52141697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 -- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 msgr2=0x7f52140c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 0x7f52140c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 -- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52140cb0c0 msgr2=0x7f52141697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52140cb0c0 0x7f52141697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5213e00640 1 -- 172.21.15.110:0/1082149726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204009390 con 0x7f521406d9e0 2024-08-17T02:29:40.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.475+0000 7f5218a00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 0x7f52140c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f5213e00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5204009130 tx=0x7f5204032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040316b0 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204031810 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204031bb0 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5214068c40 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.476+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5214069200 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.477+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5214064db0 con 0x7f521406d9e0 2024-08-17T02:29:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.478+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f520403c400 con 0x7f521406d9e0 2024-08-17T02:29:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.478+0000 7f520b400640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 0x7f51f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.479+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f52040a2340 con 0x7f521406d9e0 2024-08-17T02:29:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.479+0000 7f5213400640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 0x7f51f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.479+0000 7f5213400640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 0x7f51f4067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5200007fd0 tx=0x7f5200007c50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.482+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f52040704b0 con 0x7f521406d9e0 2024-08-17T02:29:40.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.654+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f521406e970 con 0x7f521406d9e0 2024-08-17T02:29:40.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.654+0000 7f520b400640 1 -- 172.21.15.110:0/1082149726 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5204073ad0 con 0x7f521406d9e0 2024-08-17T02:29:40.656 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 msgr2=0x7f51f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 0x7f51f4067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5200007fd0 tx=0x7f5200007c50 comp rx=0 tx=0).stop 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 msgr2=0x7f5214069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5204009130 tx=0x7f5204032000 comp rx=0 tx=0).stop 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 shutdown_connections 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51f4065150 0x7f51f4067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52140cb520 0x7f52140c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52140cb0c0 0x7f52141697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 --2- 172.21.15.110:0/1082149726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f521406d9e0 0x7f5214069ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 >> 172.21.15.110:0/1082149726 conn(0x7f5214067750 msgr2=0x7f5214157d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 shutdown_connections 2024-08-17T02:29:40.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.656+0000 7f521aa00640 1 -- 172.21.15.110:0/1082149726 wait complete. 2024-08-17T02:29:40.673 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.822+0000 7f0bba800640 1 Processor -- start 2024-08-17T02:29:40.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.822+0000 7f0bba800640 1 -- start start 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.823+0000 7f0bba800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.823+0000 7f0bba800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 0x7f0bb406a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.823+0000 7f0bba800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb40c8270 con 0x7f0bb4069a60 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.823+0000 7f0bba800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb406d470 con 0x7f0bb40c7e50 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.823+0000 7f0bba800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb40aec60 con 0x7f0bb4155550 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 0x7f0bb406a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:38604/0 (socket says 172.21.15.110:38604) 2024-08-17T02:29:40.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 -- 172.21.15.110:0/3063479524 learned_addr learned my addr 172.21.15.110:0/3063479524 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2000640 1 -- 172.21.15.110:0/3063479524 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876205659 0 0) 0x7f0bb40c8270 con 0x7f0bb4069a60 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2000640 1 -- 172.21.15.110:0/3063479524 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b980034e0 con 0x7f0bb4069a60 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 -- 172.21.15.110:0/3063479524 >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 msgr2=0x7f0bb406a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 --2- 172.21.15.110:0/3063479524 >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 0x7f0bb406a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 -- 172.21.15.110:0/3063479524 >> v1:172.21.15.177:6789/0 conn(0x7f0bb4069a60 legacy=0x7f0bb4154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb2a00640 1 -- 172.21.15.110:0/3063479524 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb406c860 con 0x7f0bb4155550 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.824+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/3063479524 >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 0x7f0bb406a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.825+0000 7f0bb2a00640 1 --2- 172.21.15.110:0/3063479524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009910 tx=0x7f0ba00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f40f9c7089a0e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.825+0000 7f0bb2000640 1 -- 172.21.15.110:0/3063479524 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba002add0 con 0x7f0bb4155550 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bb2000640 1 -- 172.21.15.110:0/3063479524 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0032440 con 0x7f0bb4155550 2024-08-17T02:29:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bb2000640 1 -- 172.21.15.110:0/3063479524 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0032820 con 0x7f0bb4155550 2024-08-17T02:29:40.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 -- 172.21.15.110:0/3063479524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 msgr2=0x7f0bb4069e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 --2- 172.21.15.110:0/3063479524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009910 tx=0x7f0ba00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 -- 172.21.15.110:0/3063479524 shutdown_connections 2024-08-17T02:29:40.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 --2- 172.21.15.110:0/3063479524 >> v2:172.21.15.177:3300/0 conn(0x7f0bb40c7e50 0x7f0bb406a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 --2- 172.21.15.110:0/3063479524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb4155550 0x7f0bb4069e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 -- 172.21.15.110:0/3063479524 >> 172.21.15.110:0/3063479524 conn(0x7f0bb4067750 msgr2=0x7f0bb40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 -- 172.21.15.110:0/3063479524 shutdown_connections 2024-08-17T02:29:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.826+0000 7f0bba800640 1 -- 172.21.15.110:0/3063479524 wait complete. 2024-08-17T02:29:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.828+0000 7f0bba800640 1 Processor -- start 2024-08-17T02:29:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.828+0000 7f0bba800640 1 -- start start 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb4069a60 0x7f0bb4152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb40c7e50 0x7f0bb4169280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4153970 con 0x7f0bb4155550 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41697c0 con 0x7f0bb4069a60 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bba800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb4153040 con 0x7f0bb40c7e50 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57014/0 (socket says 172.21.15.110:57014) 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 -- 172.21.15.110:0/411098207 learned_addr learned my addr 172.21.15.110:0/411098207 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3400640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb4069a60 0x7f0bb4152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb2a00640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb40c7e50 0x7f0bb4169280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 -- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb40c7e50 msgr2=0x7f0bb4169280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb40c7e50 0x7f0bb4169280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 -- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb4069a60 msgr2=0x7f0bb4152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:40.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb4069a60 0x7f0bb4152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:40.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.829+0000 7f0bb3e00640 1 -- 172.21.15.110:0/411098207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac009a20 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0bb3e00640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009fc0 tx=0x7f0bac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac00ce70 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac00f040 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0146d0 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba0009450 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.830+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb4153600 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.831+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4071050 con 0x7f0bb4155550 2024-08-17T02:29:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.832+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0bac003020 con 0x7f0bb4155550 2024-08-17T02:29:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.833+0000 7f0baaa00640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 0x7f0b94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.833+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bac082eb0 con 0x7f0bb4155550 2024-08-17T02:29:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.833+0000 7f0bb3400640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 0x7f0b94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.833+0000 7f0bb3400640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 0x7f0b94067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40ab580 tx=0x7f0ba4007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:40.837+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0bac050f80 con 0x7f0bb4155550 2024-08-17T02:29:41.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.009+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bb406a370 con 0x7f0bb4155550 2024-08-17T02:29:41.011 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.010+0000 7f0baaa00640 1 -- 172.21.15.110:0/411098207 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bac0545a0 con 0x7f0bb4155550 2024-08-17T02:29:41.011 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:41.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 msgr2=0x7f0b94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 0x7f0b94067600 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40ab580 tx=0x7f0ba4007cc0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 msgr2=0x7f0bb4169a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009fc0 tx=0x7f0bac00b040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 shutdown_connections 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0b94065150 0x7f0b94067600 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bb4155550 0x7f0bb4169a20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb40c7e50 0x7f0bb4169280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 --2- 172.21.15.110:0/411098207 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb4069a60 0x7f0bb4152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 >> 172.21.15.110:0/411098207 conn(0x7f0bb4067750 msgr2=0x7f0bb40c98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 shutdown_connections 2024-08-17T02:29:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.012+0000 7f0bba800640 1 -- 172.21.15.110:0/411098207 wait complete. 2024-08-17T02:29:41.028 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:41.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.176+0000 7f9747e00640 1 Processor -- start 2024-08-17T02:29:41.178 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.177+0000 7f9747e00640 1 -- start start 2024-08-17T02:29:41.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97480abef0 0x7f97480accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97480ad210 0x7f974806d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9748156e60 con 0x7f974806d930 2024-08-17T02:29:41.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97480c95e0 con 0x7f97480ad210 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97480ad660 con 0x7f97480abef0 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f974806d930 0x7f974815a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57528/0 (socket says 172.21.15.110:57528) 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f973e000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97480ad210 0x7f974806d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.178+0000 7f9747400640 1 -- 172.21.15.110:0/1090183622 learned_addr learned my addr 172.21.15.110:0/1090183622 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f9746a00640 1 --2- 172.21.15.110:0/1090183622 >> v2:172.21.15.177:3300/0 conn(0x7f97480abef0 0x7f97480accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f973e000640 1 -- 172.21.15.110:0/1090183622 >> v2:172.21.15.177:3300/0 conn(0x7f97480abef0 msgr2=0x7f97480accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f973e000640 1 --2- 172.21.15.110:0/1090183622 >> v2:172.21.15.177:3300/0 conn(0x7f97480abef0 0x7f97480accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f973e000640 1 -- 172.21.15.110:0/1090183622 >> v1:172.21.15.110:6789/0 conn(0x7f974806d930 legacy=0x7f974815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f973e000640 1 -- 172.21.15.110:0/1090183622 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480ac2c0 con 0x7f97480ad210 2024-08-17T02:29:41.181 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.179+0000 7f9746000640 1 -- 172.21.15.110:0/1090183622 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269797619 0 0) 0x7f9748156e60 con 0x7f974806d930 2024-08-17T02:29:41.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.180+0000 7f973e000640 1 --2- 172.21.15.110:0/1090183622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480ad210 0x7f974806d3f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f974806a5b0 tx=0x7f97300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac25eef0ac3ee0ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.180+0000 7f9746000640 1 -- 172.21.15.110:0/1090183622 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973002adb0 con 0x7f97480ad210 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.180+0000 7f9746000640 1 -- 172.21.15.110:0/1090183622 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730032440 con 0x7f97480ad210 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.180+0000 7f9746000640 1 -- 172.21.15.110:0/1090183622 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97300327e0 con 0x7f97480ad210 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 -- 172.21.15.110:0/1090183622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480ad210 msgr2=0x7f974806d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 --2- 172.21.15.110:0/1090183622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480ad210 0x7f974806d3f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f974806a5b0 tx=0x7f97300090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 -- 172.21.15.110:0/1090183622 shutdown_connections 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 --2- 172.21.15.110:0/1090183622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480ad210 0x7f974806d3f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 --2- 172.21.15.110:0/1090183622 >> v2:172.21.15.177:3300/0 conn(0x7f97480abef0 0x7f97480accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 -- 172.21.15.110:0/1090183622 >> 172.21.15.110:0/1090183622 conn(0x7f9748066cd0 msgr2=0x7f97480670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 -- 172.21.15.110:0/1090183622 shutdown_connections 2024-08-17T02:29:41.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.181+0000 7f9747e00640 1 -- 172.21.15.110:0/1090183622 wait complete. 2024-08-17T02:29:41.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.182+0000 7f9747e00640 1 Processor -- start 2024-08-17T02:29:41.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.182+0000 7f9747e00640 1 -- start start 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f974806d930 0x7f97481573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97480ad210 0x7f9748159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748157910 con 0x7f97480abef0 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480aa070 con 0x7f974806d930 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f9747e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480aa630 con 0x7f97480ad210 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f973e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f973e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57042/0 (socket says 172.21.15.110:57042) 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.183+0000 7f973e000640 1 -- 172.21.15.110:0/1377395530 learned_addr learned my addr 172.21.15.110:0/1377395530 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 -- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97480ad210 msgr2=0x7f9748159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97480ad210 0x7f9748159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 -- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f974806d930 msgr2=0x7f97481573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f974806d930 0x7f97481573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 -- 172.21.15.110:0/1377395530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730009390 con 0x7f97480abef0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973e000640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9730009360 tx=0x7f9730032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730031de0 con 0x7f97480abef0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973003d420 con 0x7f97480abef0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973003d7e0 con 0x7f97480abef0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748157f10 con 0x7f97480abef0 2024-08-17T02:29:41.187 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.184+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480aa2c0 con 0x7f97480abef0 2024-08-17T02:29:41.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.185+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9748071050 con 0x7f97480abef0 2024-08-17T02:29:41.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.186+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9730039040 con 0x7f97480abef0 2024-08-17T02:29:41.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.187+0000 7f973ea00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 0x7f9724067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.188 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.187+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97300a2570 con 0x7f97480abef0 2024-08-17T02:29:41.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.187+0000 7f9746a00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 0x7f9724067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.188+0000 7f9746a00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 0x7f9724067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9738006fd0 tx=0x7f9738008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.191+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9730070590 con 0x7f97480abef0 2024-08-17T02:29:41.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.361+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9748158410 con 0x7f97480abef0 2024-08-17T02:29:41.363 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.362+0000 7f973ea00640 1 -- 172.21.15.110:0/1377395530 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9730073bb0 con 0x7f97480abef0 2024-08-17T02:29:41.363 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 msgr2=0x7f9724067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 0x7f9724067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9738006fd0 tx=0x7f9738008040 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 msgr2=0x7f974814fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9730009360 tx=0x7f9730032000 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 shutdown_connections 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9724065150 0x7f9724067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97480ad210 0x7f9748159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97480abef0 0x7f974814fd00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 --2- 172.21.15.110:0/1377395530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f974806d930 0x7f97481573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 >> 172.21.15.110:0/1377395530 conn(0x7f9748066cd0 msgr2=0x7f9748152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 shutdown_connections 2024-08-17T02:29:41.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.364+0000 7f9747e00640 1 -- 172.21.15.110:0/1377395530 wait complete. 2024-08-17T02:29:41.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:29:41.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.531+0000 7f43cca00640 1 Processor -- start 2024-08-17T02:29:41.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.531+0000 7f43cca00640 1 -- start start 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f43c80ca8a0 0x7f43c80cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43c80ccad0 0x7f43c80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80cd6e0 con 0x7f43c80ccad0 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80ccf70 con 0x7f43c80ca8a0 2024-08-17T02:29:41.534 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43cca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80cadc0 con 0x7f43c8159ca0 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43c7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43c80ccad0 0x7f43c80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43c7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43c80ccad0 0x7f43c80cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57052/0 (socket says 172.21.15.110:57052) 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.532+0000 7f43c7200640 1 -- 172.21.15.110:0/308251656 learned_addr learned my addr 172.21.15.110:0/308251656 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c6800640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c5e00640 1 --2- 172.21.15.110:0/308251656 >> v2:172.21.15.177:3300/0 conn(0x7f43c80ca8a0 0x7f43c80cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c7200640 1 -- 172.21.15.110:0/308251656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 msgr2=0x7f43c80ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c7200640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c7200640 1 -- 172.21.15.110:0/308251656 >> v2:172.21.15.177:3300/0 conn(0x7f43c80ca8a0 msgr2=0x7f43c80cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c7200640 1 --2- 172.21.15.110:0/308251656 >> v2:172.21.15.177:3300/0 conn(0x7f43c80ca8a0 0x7f43c80cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.533+0000 7f43c7200640 1 -- 172.21.15.110:0/308251656 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c80cb060 con 0x7f43c80ccad0 2024-08-17T02:29:41.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.534+0000 7f43c7200640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ccad0 0x7f43c80cdb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43c8088cf0 tx=0x7f43c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732c043350e14fc5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.534+0000 7f43c5400640 1 -- 172.21.15.110:0/308251656 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0031400 con 0x7f43c80ccad0 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.534+0000 7f43c5400640 1 -- 172.21.15.110:0/308251656 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c002d050 con 0x7f43c80ccad0 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.534+0000 7f43c5400640 1 -- 172.21.15.110:0/308251656 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c00317d0 con 0x7f43c80ccad0 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 -- 172.21.15.110:0/308251656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ccad0 msgr2=0x7f43c80cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ccad0 0x7f43c80cdb30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f43c8088cf0 tx=0x7f43c0009840 comp rx=0 tx=0).stop 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 -- 172.21.15.110:0/308251656 shutdown_connections 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ccad0 0x7f43c80cdb30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 --2- 172.21.15.110:0/308251656 >> v2:172.21.15.177:3300/0 conn(0x7f43c80ca8a0 0x7f43c80cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 --2- 172.21.15.110:0/308251656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 -- 172.21.15.110:0/308251656 >> 172.21.15.110:0/308251656 conn(0x7f43c8098e00 msgr2=0x7f43c806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 -- 172.21.15.110:0/308251656 shutdown_connections 2024-08-17T02:29:41.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.535+0000 7f43cca00640 1 -- 172.21.15.110:0/308251656 wait complete. 2024-08-17T02:29:41.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.536+0000 7f43cca00640 1 Processor -- start 2024-08-17T02:29:41.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.536+0000 7f43cca00640 1 -- start start 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80ccad0 0x7f43c80c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c80c6690 con 0x7f43c80ca8a0 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c809b4f0 con 0x7f43c80ccad0 2024-08-17T02:29:41.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43cca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c809abc0 con 0x7f43c8159ca0 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.537+0000 7f43c6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57068/0 (socket says 172.21.15.110:57068) 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 -- 172.21.15.110:0/1421804005 learned_addr learned my addr 172.21.15.110:0/1421804005 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c5e00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80ccad0 0x7f43c80c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c7200640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 -- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 msgr2=0x7f43c80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 -- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80ccad0 msgr2=0x7f43c80c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80ccad0 0x7f43c80c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:41.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 -- 172.21.15.110:0/1421804005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009ae0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43c6800640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f43b800d890 tx=0x7f43b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.538+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800de20 con 0x7f43c80ca8a0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.539+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b80098b0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.539+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8009c50 con 0x7f43c80ca8a0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.539+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c809aea0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.539+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c809a8b0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.540+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c80650c0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.540+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f43b8014620 con 0x7f43c80ca8a0 2024-08-17T02:29:41.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.542+0000 7f43be000640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 0x7f43a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:41.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.542+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43b8082be0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.542+0000 7f43c5e00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 0x7f43a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:41.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.542+0000 7f43c5e00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 0x7f43a8067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43c8069190 tx=0x7f43b4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:41.547 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.546+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43c80650c0 con 0x7f43c80ca8a0 2024-08-17T02:29:41.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:41.784+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f43c80650c0 con 0x7f43c80ca8a0 2024-08-17T02:29:42.583 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.582+0000 7f43be000640 1 -- 172.21.15.110:0/1421804005 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7f43c80650c0 con 0x7f43c80ca8a0 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 msgr2=0x7f43a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 0x7f43a8067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f43c8069190 tx=0x7f43b4008040 comp rx=0 tx=0).stop 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 msgr2=0x7f43c81550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f43b800d890 tx=0x7f43b8008040 comp rx=0 tx=0).stop 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 shutdown_connections 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f43a8065150 0x7f43a8067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43c8159ca0 0x7f43c80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43c80ccad0 0x7f43c80c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 --2- 172.21.15.110:0/1421804005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80ca8a0 0x7f43c81550f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.584+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 >> 172.21.15.110:0/1421804005 conn(0x7f43c8098e00 msgr2=0x7f43c8155d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.585+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 shutdown_connections 2024-08-17T02:29:42.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.585+0000 7f43cca00640 1 -- 172.21.15.110:0/1421804005 wait complete. 2024-08-17T02:29:42.603 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:29:42.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.754+0000 7f68c1a00640 1 Processor -- start 2024-08-17T02:29:42.755 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.754+0000 7f68c1a00640 1 -- start start 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68c1a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f68bc155a80 0x7f68bc06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68c1a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68bc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68c1a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68bc1598f0 con 0x7f68bc155e50 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68c1a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68bc159bd0 con 0x7f68bc155a80 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68c1a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc159eb0 con 0x7f68bc0c7db0 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68bb400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f68bc155e50 0x7f68bc06c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:57534/0 (socket says 172.21.15.110:57534) 2024-08-17T02:29:42.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.755+0000 7f68bb400640 1 -- 172.21.15.110:0/2948094221 learned_addr learned my addr 172.21.15.110:0/2948094221 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68ba000640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68bc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68baa00640 1 --2- 172.21.15.110:0/2948094221 >> v2:172.21.15.177:3300/0 conn(0x7f68bc155a80 0x7f68bc06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178964933 0 0) 0x7f68bc1598f0 con 0x7f68bc155e50 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a00034e0 con 0x7f68bc155e50 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2424488839 0 0) 0x7f68a00034e0 con 0x7f68bc155e50 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 msgr2=0x7f68bc0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68bc0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 >> v2:172.21.15.177:3300/0 conn(0x7f68bc155a80 msgr2=0x7f68bc06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 --2- 172.21.15.110:0/2948094221 >> v2:172.21.15.177:3300/0 conn(0x7f68bc155a80 0x7f68bc06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc15a190 con 0x7f68bc155e50 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f68b40017f0 con 0x7f68bc155e50 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 >> v1:172.21.15.110:6789/0 conn(0x7f68bc155e50 legacy=0x7f68bc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00039d0 0x7f68a0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.759 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68a0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a0004cc0 0x7f68a0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc159bd0 con 0x7f68a00039d0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc159eb0 con 0x7f68a0004cc0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a000b9d0 con 0x7f68bc0c7db0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.756+0000 7f68baa00640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00039d0 0x7f68a0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68ba000640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68a0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68bb400640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a0004cc0 0x7f68a0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68baa00640 1 -- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 msgr2=0x7f68a0004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68baa00640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc0c7db0 0x7f68a0004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68baa00640 1 -- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a0004cc0 msgr2=0x7f68a0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68baa00640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a0004cc0 0x7f68a0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.757+0000 7f68baa00640 1 -- 172.21.15.110:0/2948094221 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00034e0 con 0x7f68a00039d0 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.758+0000 7f68baa00640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00039d0 0x7f68a0003de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009b70 tx=0x7f68ac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9765b144cd4eeeb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.758+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac031400 con 0x7f68a00039d0 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.758+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac02d050 con 0x7f68a00039d0 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.758+0000 7f68b9600640 1 -- 172.21.15.110:0/2948094221 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac031790 con 0x7f68a00039d0 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 -- 172.21.15.110:0/2948094221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00039d0 msgr2=0x7f68a0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 --2- 172.21.15.110:0/2948094221 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68a00039d0 0x7f68a0003de0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009b70 tx=0x7f68ac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68bb400640 1 -- 172.21.15.110:0/2948094221 reap_dead start 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 -- 172.21.15.110:0/2948094221 shutdown_connections 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 -- 172.21.15.110:0/2948094221 >> 172.21.15.110:0/2948094221 conn(0x7f68bc067750 msgr2=0x7f68bc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 -- 172.21.15.110:0/2948094221 shutdown_connections 2024-08-17T02:29:42.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.759+0000 7f68c1a00640 1 -- 172.21.15.110:0/2948094221 wait complete. 2024-08-17T02:29:42.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.760+0000 7f68c1a00640 1 Processor -- start 2024-08-17T02:29:42.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.760+0000 7f68c1a00640 1 -- start start 2024-08-17T02:29:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a00039d0 0x7f68bc1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc13d950 0x7f68bc156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc157c50 con 0x7f68bc157220 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc0ae240 con 0x7f68a00039d0 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.761+0000 7f68c1a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68bc157690 con 0x7f68bc13d950 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57090/0 (socket says 172.21.15.110:57090) 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68baa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a00039d0 0x7f68bc1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 -- 172.21.15.110:0/3482965356 learned_addr learned my addr 172.21.15.110:0/3482965356 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68ba000640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc13d950 0x7f68bc156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 -- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc13d950 msgr2=0x7f68bc156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc13d950 0x7f68bc156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 -- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a00039d0 msgr2=0x7f68bc1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a00039d0 0x7f68bc1418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 -- 172.21.15.110:0/3482965356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc157970 con 0x7f68bc157220 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68bb400640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f68bc156220 tx=0x7f68b4001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.762+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400e620 con 0x7f68bc157220 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.763+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400e780 con 0x7f68bc157220 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.763+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400eb40 con 0x7f68bc157220 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.763+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68bc1459d0 con 0x7f68bc157220 2024-08-17T02:29:42.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.763+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68bc141f80 con 0x7f68bc157220 2024-08-17T02:29:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.764+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68bc145bc0 con 0x7f68bc157220 2024-08-17T02:29:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.764+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f68b401d460 con 0x7f68bc157220 2024-08-17T02:29:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.765+0000 7f68b2000640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 0x7f689c0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.765+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68b40820d0 con 0x7f68bc157220 2024-08-17T02:29:42.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.765+0000 7f68baa00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 0x7f689c0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:42.768 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.766+0000 7f68baa00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 0x7f689c0676d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68ac034000 tx=0x7f68ac035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:42.771 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.770+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f68b40502c0 con 0x7f68bc157220 2024-08-17T02:29:42.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.939+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f68bc157d90 con 0x7f68bc157220 2024-08-17T02:29:42.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.944+0000 7f68b2000640 1 -- 172.21.15.110:0/3482965356 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f68b4057e60 con 0x7f68bc157220 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 msgr2=0x7f689c0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 0x7f689c0676d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f68ac034000 tx=0x7f68ac035000 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 msgr2=0x7f68bc145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f68bc156220 tx=0x7f68b4001330 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 shutdown_connections 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f689c065220 0x7f689c0676d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68bc157220 0x7f68bc145ef0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68bc13d950 0x7f68bc156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 --2- 172.21.15.110:0/3482965356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a00039d0 0x7f68bc1418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 >> 172.21.15.110:0/3482965356 conn(0x7f68bc067750 msgr2=0x7f68bc068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 shutdown_connections 2024-08-17T02:29:42.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:42.946+0000 7f68c1a00640 1 -- 172.21.15.110:0/3482965356 wait complete. 2024-08-17T02:29:42.963 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:29:42.964 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:43.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:29:43.149 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:29:43.149 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:29:43.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:43.149 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:29:43.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:29:43.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:43.210 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:29:43.261 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:29:43.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:43.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:29:43.324 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:29:43.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:43.325 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:29:43.371 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:29:43.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:43.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:29:43.431 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:29:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:43.431 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:29:43.467 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:29:43.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:29:43.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:29:43.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:29:43.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:29:43.528 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:29:43.564 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:29:43.564 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:43.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.712+0000 7f9220800640 1 Processor -- start 2024-08-17T02:29:43.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.712+0000 7f9220800640 1 -- start start 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.713+0000 7f9220800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9218155a20 0x7f92180adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.713+0000 7f9220800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 0x7f92180ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.713+0000 7f9220800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f921806d7f0 0x7f921806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f9220800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92180b0350 con 0x7f9218155a20 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f9220800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9218156670 con 0x7f9218155df0 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f9220800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921806e180 con 0x7f921806d7f0 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9218155a20 0x7f92180adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9218155a20 0x7f92180adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57102/0 (socket says 172.21.15.110:57102) 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 -- 172.21.15.110:0/4110531507 learned_addr learned my addr 172.21.15.110:0/4110531507 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:43.716 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921d400640 1 --2- 172.21.15.110:0/4110531507 >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 0x7f92180ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921e800640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f921806d7f0 0x7f921806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 -- 172.21.15.110:0/4110531507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f921806d7f0 msgr2=0x7f921806dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f921806d7f0 0x7f921806dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 -- 172.21.15.110:0/4110531507 >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 msgr2=0x7f92180ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 --2- 172.21.15.110:0/4110531507 >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 0x7f92180ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921de00640 1 -- 172.21.15.110:0/4110531507 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921806e5e0 con 0x7f9218155a20 2024-08-17T02:29:43.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.714+0000 7f921d400640 1 --2- 172.21.15.110:0/4110531507 >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 0x7f92180ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.715+0000 7f921de00640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180adf10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f921806aa10 tx=0x7f920c00b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aa725efdcdfe09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f921ca00640 1 -- 172.21.15.110:0/4110531507 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c032640 con 0x7f9218155a20 2024-08-17T02:29:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f921ca00640 1 -- 172.21.15.110:0/4110531507 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c0327a0 con 0x7f9218155a20 2024-08-17T02:29:43.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f921ca00640 1 -- 172.21.15.110:0/4110531507 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c032b80 con 0x7f9218155a20 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 -- 172.21.15.110:0/4110531507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 msgr2=0x7f92180adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180adf10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f921806aa10 tx=0x7f920c00b460 comp rx=0 tx=0).stop 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 -- 172.21.15.110:0/4110531507 shutdown_connections 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f921806d7f0 0x7f921806dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 --2- 172.21.15.110:0/4110531507 >> v2:172.21.15.177:3300/0 conn(0x7f9218155df0 0x7f92180ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 --2- 172.21.15.110:0/4110531507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180adf10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 -- 172.21.15.110:0/4110531507 >> 172.21.15.110:0/4110531507 conn(0x7f92180cb9b0 msgr2=0x7f92180cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 -- 172.21.15.110:0/4110531507 shutdown_connections 2024-08-17T02:29:43.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.716+0000 7f9220800640 1 -- 172.21.15.110:0/4110531507 wait complete. 2024-08-17T02:29:43.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.718+0000 7f9220800640 1 Processor -- start 2024-08-17T02:29:43.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.718+0000 7f9220800640 1 -- start start 2024-08-17T02:29:43.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f921806d7f0 0x7f9218147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9218155df0 0x7f92180c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92180ae230 con 0x7f9218155a20 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c2980 con 0x7f921806d7f0 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f9220800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92180c2050 con 0x7f9218155df0 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:57116/0 (socket says 172.21.15.110:57116) 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 -- 172.21.15.110:0/3591251106 learned_addr learned my addr 172.21.15.110:0/3591251106 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921e800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9218155df0 0x7f92180c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921de00640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f921806d7f0 0x7f9218147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 -- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9218155df0 msgr2=0x7f92180c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9218155df0 0x7f92180c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 -- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f921806d7f0 msgr2=0x7f9218147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f921806d7f0 0x7f9218147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.719+0000 7f921d400640 1 -- 172.21.15.110:0/3591251106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208009390 con 0x7f9218155a20 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f921d400640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f920800ea80 tx=0x7f92080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920800ca10 con 0x7f9218155a20 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800cb70 con 0x7f9218155a20 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208013470 con 0x7f9218155a20 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c00b700 con 0x7f9218155a20 2024-08-17T02:29:43.723 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.720+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92180c2610 con 0x7f9218155a20 2024-08-17T02:29:43.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.721+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92180c2b10 con 0x7f9218155a20 2024-08-17T02:29:43.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.722+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f92080137e0 con 0x7f9218155a20 2024-08-17T02:29:43.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.723+0000 7f9211600640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 0x7f91fc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:43.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.723+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9208082430 con 0x7f9218155a20 2024-08-17T02:29:43.724 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.723+0000 7f921de00640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 0x7f91fc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:43.725 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.724+0000 7f921de00640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 0x7f91fc067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f920c037000 tx=0x7f920c03a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:43.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.727+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9208050540 con 0x7f9218155a20 2024-08-17T02:29:43.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.936+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9218064db0 con 0x7f9218155a20 2024-08-17T02:29:43.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.937+0000 7f9211600640 1 -- 172.21.15.110:0/3591251106 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f9208053b60 con 0x7f9218155a20 2024-08-17T02:29:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:43.938 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:43.938 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:43.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 msgr2=0x7f91fc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 0x7f91fc067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f920c037000 tx=0x7f920c03a000 comp rx=0 tx=0).stop 2024-08-17T02:29:43.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 msgr2=0x7f92180c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:43.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f920800ea80 tx=0x7f92080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 shutdown_connections 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f91fc065150 0x7f91fc067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9218155df0 0x7f92180c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9218155a20 0x7f92180c40e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 --2- 172.21.15.110:0/3591251106 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f921806d7f0 0x7f9218147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 >> 172.21.15.110:0/3591251106 conn(0x7f92180cb9b0 msgr2=0x7f9218152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 shutdown_connections 2024-08-17T02:29:43.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:43.939+0000 7f9220800640 1 -- 172.21.15.110:0/3591251106 wait complete. 2024-08-17T02:29:43.956 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:44.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:44.047 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:44.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.105+0000 7fcae0000640 1 Processor -- start 2024-08-17T02:29:44.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.105+0000 7fcae0000640 1 -- start start 2024-08-17T02:29:44.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.106+0000 7fcae0000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcad80aa8f0 0x7fcad806be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcae0000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad806b9d0 con 0x7fcad815c600 2024-08-17T02:29:44.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcae0000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad806ebf0 con 0x7fcad815c230 2024-08-17T02:29:44.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcae0000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad80aad80 con 0x7fcad80aa8f0 2024-08-17T02:29:44.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcade000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcad815c600 0x7fcad8066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43040/0 (socket says 172.21.15.110:43040) 2024-08-17T02:29:44.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcade000640 1 -- 172.21.15.110:0/3411755389 learned_addr learned my addr 172.21.15.110:0/3411755389 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:44.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcadcc00640 1 --2- 172.21.15.110:0/3411755389 >> v2:172.21.15.177:3300/0 conn(0x7fcad80aa8f0 0x7fcad806be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319577853 0 0) 0x7fcad806b9d0 con 0x7fcad815c600 2024-08-17T02:29:44.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac00034e0 con 0x7fcad815c600 2024-08-17T02:29:44.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcadcc00640 1 -- 172.21.15.110:0/3411755389 >> v1:172.21.15.177:6789/0 conn(0x7fcad815c230 legacy=0x7fcad806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649228048 0 0) 0x7fcad806ebf0 con 0x7fcad815c230 2024-08-17T02:29:44.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.107+0000 7fcadcc00640 1 -- 172.21.15.110:0/3411755389 >> v1:172.21.15.110:6789/0 conn(0x7fcad815c600 legacy=0x7fcad8066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.108+0000 7fcadcc00640 1 -- 172.21.15.110:0/3411755389 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80ab060 con 0x7fcad80aa8f0 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcadcc00640 1 --2- 172.21.15.110:0/3411755389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad80aa8f0 0x7fcad806be60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009850 tx=0x7fcac40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62209f760f092702 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac402ae20 con 0x7fcad80aa8f0 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4032440 con 0x7fcad80aa8f0 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcad7e00640 1 -- 172.21.15.110:0/3411755389 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40327e0 con 0x7fcad80aa8f0 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 -- 172.21.15.110:0/3411755389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad80aa8f0 msgr2=0x7fcad806be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 --2- 172.21.15.110:0/3411755389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad80aa8f0 0x7fcad806be60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009850 tx=0x7fcac40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 -- 172.21.15.110:0/3411755389 shutdown_connections 2024-08-17T02:29:44.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 --2- 172.21.15.110:0/3411755389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad80aa8f0 0x7fcad806be60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 -- 172.21.15.110:0/3411755389 >> 172.21.15.110:0/3411755389 conn(0x7fcad806d8f0 msgr2=0x7fcad806dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.109+0000 7fcae0000640 1 -- 172.21.15.110:0/3411755389 shutdown_connections 2024-08-17T02:29:44.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.110+0000 7fcae0000640 1 -- 172.21.15.110:0/3411755389 wait complete. 2024-08-17T02:29:44.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.111+0000 7fcae0000640 1 Processor -- start 2024-08-17T02:29:44.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.111+0000 7fcae0000640 1 -- start start 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcad80aa8f0 0x7fcad8145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 0x7fcad80c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c52b0 con 0x7fcad815c230 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c3430 con 0x7fcad815c600 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcae0000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad80c46a0 con 0x7fcad80aa8f0 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcadcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcadcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60192/0 (socket says 172.21.15.110:60192) 2024-08-17T02:29:44.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcadcc00640 1 -- 172.21.15.110:0/2958183236 learned_addr learned my addr 172.21.15.110:0/2958183236 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcade000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 0x7fcad80c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.112+0000 7fcadd600640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcad80aa8f0 0x7fcad8145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 -- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcad80aa8f0 msgr2=0x7fcad8145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcad80aa8f0 0x7fcad8145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 -- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 msgr2=0x7fcad80c2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 0x7fcad80c2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 -- 172.21.15.110:0/2958183236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009390 con 0x7fcad815c230 2024-08-17T02:29:44.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcade000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 0x7fcad80c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcadcc00640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009850 tx=0x7fcac4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031a60 con 0x7fcad815c230 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4031bc0 con 0x7fcad815c230 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad80c4980 con 0x7fcad815c230 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac403d420 con 0x7fcad815c230 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.113+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad80c4f40 con 0x7fcad815c230 2024-08-17T02:29:44.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.114+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad80c5420 con 0x7fcad815c230 2024-08-17T02:29:44.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.115+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcac4039040 con 0x7fcad815c230 2024-08-17T02:29:44.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.116+0000 7fcad4c00640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 0x7fcab8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.116+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcac40a1ff0 con 0x7fcad815c230 2024-08-17T02:29:44.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.116+0000 7fcadd600640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 0x7fcab8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.117+0000 7fcadd600640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 0x7fcab8067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0011e0 tx=0x7fcacc007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.120+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcac40d3e40 con 0x7fcad815c230 2024-08-17T02:29:44.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.295+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcad8064db0 con 0x7fcad815c230 2024-08-17T02:29:44.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.297+0000 7fcad4c00640 1 -- 172.21.15.110:0/2958183236 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fcac4070100 con 0x7fcad815c230 2024-08-17T02:29:44.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:44.299 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:44.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 msgr2=0x7fcab8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 0x7fcab8067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0011e0 tx=0x7fcacc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 msgr2=0x7fcad80c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009850 tx=0x7fcac4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 shutdown_connections 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcab8065150 0x7fcab8067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcad815c600 0x7fcad80c2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcad815c230 0x7fcad80c29b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 --2- 172.21.15.110:0/2958183236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcad80aa8f0 0x7fcad8145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 >> 172.21.15.110:0/2958183236 conn(0x7fcad806d8f0 msgr2=0x7fcad80b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 shutdown_connections 2024-08-17T02:29:44.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.299+0000 7fcae0000640 1 -- 172.21.15.110:0/2958183236 wait complete. 2024-08-17T02:29:44.316 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:07.045438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:07.855922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:29:44.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:44.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.464+0000 7f4bd8a00640 1 Processor -- start 2024-08-17T02:29:44.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.465+0000 7f4bd8a00640 1 -- start start 2024-08-17T02:29:44.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd8a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4bd4153320 0x7f4bd40aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd8a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd40ad940 con 0x7f4bd40673e0 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd8a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd4159b20 con 0x7f4bd4159340 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd8a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd406e700 con 0x7f4bd4153320 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd2800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4bd40673e0 0x7f4bd4162970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43042/0 (socket says 172.21.15.110:43042) 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.466+0000 7f4bd2800640 1 -- 172.21.15.110:0/2236870620 learned_addr learned my addr 172.21.15.110:0/2236870620 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:44.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687654944 0 0) 0x7f4bd40ad940 con 0x7f4bd40673e0 2024-08-17T02:29:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd1e00640 1 --2- 172.21.15.110:0/2236870620 >> v2:172.21.15.177:3300/0 conn(0x7f4bd4153320 0x7f4bd40aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb80034e0 con 0x7f4bd40673e0 2024-08-17T02:29:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836546508 0 0) 0x7f4bb80034e0 con 0x7f4bd40673e0 2024-08-17T02:29:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 >> v2:172.21.15.177:3300/0 conn(0x7f4bd4153320 msgr2=0x7f4bd40aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:44.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 --2- 172.21.15.110:0/2236870620 >> v2:172.21.15.177:3300/0 conn(0x7f4bd4153320 0x7f4bd40aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 >> v1:172.21.15.177:6789/0 conn(0x7f4bd4159340 legacy=0x7f4bd4066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4159e00 con 0x7f4bd40673e0 2024-08-17T02:29:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f4bcc0017f0 con 0x7f4bd40673e0 2024-08-17T02:29:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 >> v1:172.21.15.110:6789/0 conn(0x7f4bd40673e0 legacy=0x7f4bd4162970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bb80039d0 0x7f4bb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bb8004780 0x7f4bb8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd406e700 con 0x7f4bb8005130 2024-08-17T02:29:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800c0d0 con 0x7f4bb8004780 2024-08-17T02:29:44.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb800c290 con 0x7f4bb80039d0 2024-08-17T02:29:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd2800640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd1e00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bb80039d0 0x7f4bb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.467+0000 7f4bd1400640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bb8004780 0x7f4bb8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.468+0000 7f4bd2800640 1 -- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bb80039d0 msgr2=0x7f4bb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:44.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.468+0000 7f4bd2800640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bb80039d0 0x7f4bb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.468+0000 7f4bd2800640 1 -- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bb8004780 msgr2=0x7f4bb8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.468+0000 7f4bd2800640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bb8004780 0x7f4bb8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.468+0000 7f4bd2800640 1 -- 172.21.15.110:0/2236870620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80034e0 con 0x7f4bb8005130 2024-08-17T02:29:44.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd2800640 1 -- 172.21.15.110:0/2236870620 reap_dead start 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd2800640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bb800b9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00a930 tx=0x7f4bcc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80c0b953d6b51a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc02c4e0 con 0x7f4bb8005130 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc02c660 con 0x7f4bb8005130 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd0a00640 1 -- 172.21.15.110:0/2236870620 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc02ca20 con 0x7f4bb8005130 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 msgr2=0x7f4bb800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.469+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bb800b9d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00a930 tx=0x7f4bcc0021d0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.470+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2236870620 shutdown_connections 2024-08-17T02:29:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.470+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2236870620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bb800b9d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.470+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2236870620 >> 172.21.15.110:0/2236870620 conn(0x7f4bd406d8b0 msgr2=0x7f4bd406dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.470+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2236870620 shutdown_connections 2024-08-17T02:29:44.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.470+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2236870620 wait complete. 2024-08-17T02:29:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.471+0000 7f4bd8a00640 1 Processor -- start 2024-08-17T02:29:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.471+0000 7f4bd8a00640 1 -- start start 2024-08-17T02:29:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd413dd00 0x7f4bd41536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd413e170 0x7f4bd4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd4156d40 con 0x7f4bb8005130 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd4156a60 con 0x7f4bd413dd00 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd8a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd415d8b0 con 0x7f4bd413e170 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60214/0 (socket says 172.21.15.110:60214) 2024-08-17T02:29:44.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd1e00640 1 -- 172.21.15.110:0/2147637853 learned_addr learned my addr 172.21.15.110:0/2147637853 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd2800640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd413e170 0x7f4bd4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.472+0000 7f4bd1400640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd413dd00 0x7f4bd41536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 -- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd413e170 msgr2=0x7f4bd4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd413e170 0x7f4bd4153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 -- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd413dd00 msgr2=0x7f4bd41536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd413dd00 0x7f4bd41536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 -- 172.21.15.110:0/2147637853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd415db90 con 0x7f4bb8005130 2024-08-17T02:29:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd1e00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011a60 tx=0x7f4bc40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400fb00 con 0x7f4bb8005130 2024-08-17T02:29:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400fc60 con 0x7f4bb8005130 2024-08-17T02:29:44.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd415de70 con 0x7f4bb8005130 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4014440 con 0x7f4bb8005130 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.473+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd4155ee0 con 0x7f4bb8005130 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.474+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd415d710 con 0x7f4bb8005130 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.475+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4bc4014870 con 0x7f4bb8005130 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.476+0000 7f4bc9600640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 0x7f4bb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.476+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4bc4018030 con 0x7f4bb8005130 2024-08-17T02:29:44.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.476+0000 7f4bd1400640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 0x7f4bb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.477+0000 7f4bd1400640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 0x7f4bb4067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bd416bc80 tx=0x7f4bc0007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.480+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4bd415d710 con 0x7f4bb8005130 2024-08-17T02:29:44.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.652+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bd415d710 con 0x7f4bb8005130 2024-08-17T02:29:44.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.653+0000 7f4bc9600640 1 -- 172.21.15.110:0/2147637853 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bd415d710 con 0x7f4bb8005130 2024-08-17T02:29:44.654 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:44.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.654+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 msgr2=0x7f4bb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.654+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 0x7f4bb4067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4bd416bc80 tx=0x7f4bc0007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.654+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 msgr2=0x7f4bd41698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.654+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4011a60 tx=0x7f4bc40090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 shutdown_connections 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4bb4065150 0x7f4bb4067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd413e170 0x7f4bd4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd413dd00 0x7f4bd41536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 --2- 172.21.15.110:0/2147637853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bb8005130 0x7f4bd41698f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 >> 172.21.15.110:0/2147637853 conn(0x7f4bd406d8b0 msgr2=0x7f4bd406afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 shutdown_connections 2024-08-17T02:29:44.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.655+0000 7f4bd8a00640 1 -- 172.21.15.110:0/2147637853 wait complete. 2024-08-17T02:29:44.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:29:44.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.820+0000 7f800be00640 1 Processor -- start 2024-08-17T02:29:44.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.821+0000 7f800be00640 1 -- start start 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f800c158940 0x7f800c15d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800be00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c06e660 con 0x7f800c158d10 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800be00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0a9b70 con 0x7f800c158940 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c06da50 con 0x7f800c0673e0 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f8003e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f800c158d10 0x7f800c066cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43052/0 (socket says 172.21.15.110:43052) 2024-08-17T02:29:44.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f8003e00640 1 -- 172.21.15.110:0/3288042569 learned_addr learned my addr 172.21.15.110:0/3288042569 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800aa00640 1 --2- 172.21.15.110:0/3288042569 >> v2:172.21.15.177:3300/0 conn(0x7f800c158940 0x7f800c15d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.822+0000 7f800b400640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784766176 0 0) 0x7f800c06e660 con 0x7f800c158d10 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ff00034e0 con 0x7f800c158d10 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800aa00640 1 -- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 msgr2=0x7f800c0b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800aa00640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825271772 0 0) 0x7f7ff00034e0 con 0x7f800c158d10 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800aa00640 1 -- 172.21.15.110:0/3288042569 >> v1:172.21.15.110:6789/0 conn(0x7f800c158d10 legacy=0x7f800c066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.823+0000 7f800aa00640 1 -- 172.21.15.110:0/3288042569 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c06dd30 con 0x7f800c158940 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.824+0000 7f800aa00640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c15d140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009850 tx=0x7f7ffc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1034e045c19fb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.824+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4001470 con 0x7f800c158940 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.824+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ffc02a9b0 con 0x7f800c158940 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.824+0000 7f800a000640 1 -- 172.21.15.110:0/3288042569 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc02ad50 con 0x7f800c158940 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 -- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 msgr2=0x7f800c15d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c15d140 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc009850 tx=0x7f7ffc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 -- 172.21.15.110:0/3288042569 shutdown_connections 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 --2- 172.21.15.110:0/3288042569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c15d140 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 -- 172.21.15.110:0/3288042569 >> 172.21.15.110:0/3288042569 conn(0x7f800c067de0 msgr2=0x7f800c0681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 -- 172.21.15.110:0/3288042569 shutdown_connections 2024-08-17T02:29:44.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.825+0000 7f800be00640 1 -- 172.21.15.110:0/3288042569 wait complete. 2024-08-17T02:29:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.826+0000 7f800be00640 1 Processor -- start 2024-08-17T02:29:44.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.827+0000 7f800be00640 1 -- start start 2024-08-17T02:29:44.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.827+0000 7f800be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c0cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c166c10 con 0x7f800c158d10 2024-08-17T02:29:44.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0c2a20 con 0x7f800c158940 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c0c2d00 con 0x7f800c0673e0 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60230/0 (socket says 172.21.15.110:60230) 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 -- 172.21.15.110:0/1397033938 learned_addr learned my addr 172.21.15.110:0/1397033938 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800aa00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f8003e00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c0cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 -- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 msgr2=0x7f800c0c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 -- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 msgr2=0x7f800c0cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c0cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f800b400640 1 -- 172.21.15.110:0/1397033938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc009390 con 0x7f800c158d10 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.828+0000 7f8003e00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c0cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f800b400640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8004009ec0 tx=0x7f800400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400ce10 con 0x7f800c158d10 2024-08-17T02:29:44.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400f040 con 0x7f800c158d10 2024-08-17T02:29:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c0c2fe0 con 0x7f800c158d10 2024-08-17T02:29:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80040146d0 con 0x7f800c158d10 2024-08-17T02:29:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.829+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c146f00 con 0x7f800c158d10 2024-08-17T02:29:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.830+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c166dc0 con 0x7f800c158d10 2024-08-17T02:29:44.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.831+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8004014a40 con 0x7f800c158d10 2024-08-17T02:29:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.832+0000 7f8002000640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 0x7f7fe8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.832+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80040832b0 con 0x7f800c158d10 2024-08-17T02:29:44.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.832+0000 7f800aa00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 0x7f7fe8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:44.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.833+0000 7f800aa00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 0x7f7fe8067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:44.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:44.836+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f800c166dc0 con 0x7f800c158d10 2024-08-17T02:29:45.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.008+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f800c071050 con 0x7f800c158d10 2024-08-17T02:29:45.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.008+0000 7f8002000640 1 -- 172.21.15.110:0/1397033938 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f80040512d0 con 0x7f800c158d10 2024-08-17T02:29:45.010 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:29:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.010+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 msgr2=0x7f7fe8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.010+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 0x7f7fe8067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc034000 tx=0x7f7ffc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.010+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 msgr2=0x7f800c0cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.010+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8004009ec0 tx=0x7f800400b040 comp rx=0 tx=0).stop 2024-08-17T02:29:45.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 shutdown_connections 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7fe8065150 0x7f7fe8067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f800c158d10 0x7f800c0cbf90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f800c158940 0x7f800c0cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 --2- 172.21.15.110:0/1397033938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f800c0673e0 0x7f800c0c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 >> 172.21.15.110:0/1397033938 conn(0x7f800c067de0 msgr2=0x7f800c0cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 shutdown_connections 2024-08-17T02:29:45.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.011+0000 7f800be00640 1 -- 172.21.15.110:0/1397033938 wait complete. 2024-08-17T02:29:45.028 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:29:45.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.179+0000 7f51f2200640 1 Processor -- start 2024-08-17T02:29:45.180 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.179+0000 7f51f2200640 1 -- start start 2024-08-17T02:29:45.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.180+0000 7f51f2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 0x7f51ec06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.180+0000 7f51f2200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec1598f0 con 0x7f51ec0c92e0 2024-08-17T02:29:45.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.180+0000 7f51f2200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec159bd0 con 0x7f51ec0c7db0 2024-08-17T02:29:45.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.180+0000 7f51f2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec159eb0 con 0x7f51ec155a80 2024-08-17T02:29:45.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ebe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f51ec0c92e0 0x7f51ec0aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43054/0 (socket says 172.21.15.110:43054) 2024-08-17T02:29:45.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ebe00640 1 -- 172.21.15.110:0/1939641136 learned_addr learned my addr 172.21.15.110:0/1939641136 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:45.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51eb400640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 0x7f51ec06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761412206 0 0) 0x7f51ec1598f0 con 0x7f51ec0c92e0 2024-08-17T02:29:45.183 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d00034e0 con 0x7f51ec0c92e0 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740494596 0 0) 0x7f51d00034e0 con 0x7f51ec0c92e0 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 msgr2=0x7f51ec06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 0x7f51ec06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 >> v1:172.21.15.177:6789/0 conn(0x7f51ec0c7db0 legacy=0x7f51ec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec15a190 con 0x7f51ec0c92e0 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f51e40017f0 con 0x7f51ec0c92e0 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.181+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 >> v1:172.21.15.110:6789/0 conn(0x7f51ec0c92e0 legacy=0x7f51ec0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0003a00 0x7f51d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0004780 0x7f51d0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 0x7f51d0005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.185 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec159eb0 con 0x7f51d0004780 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d000bad0 con 0x7f51d0003a00 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d000bc90 con 0x7f51ec155a80 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0004780 0x7f51d0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 -- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 msgr2=0x7f51d0005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec155a80 0x7f51d0005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 -- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0003a00 msgr2=0x7f51d0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0003a00 0x7f51d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.182+0000 7f51eaa00640 1 -- 172.21.15.110:0/1939641136 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00034e0 con 0x7f51d0004780 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.183+0000 7f51eaa00640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0004780 0x7f51d0004bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001800 tx=0x7f51d8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cda0689e8794af server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.183+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d802a900 con 0x7f51d0004780 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.183+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d802aa80 con 0x7f51d0004780 2024-08-17T02:29:45.186 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.183+0000 7f51ea000640 1 -- 172.21.15.110:0/1939641136 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d802ae40 con 0x7f51d0004780 2024-08-17T02:29:45.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 -- 172.21.15.110:0/1939641136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0004780 msgr2=0x7f51d0004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 --2- 172.21.15.110:0/1939641136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d0004780 0x7f51d0004bf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001800 tx=0x7f51d8007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51ebe00640 1 -- 172.21.15.110:0/1939641136 reap_dead start 2024-08-17T02:29:45.189 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 -- 172.21.15.110:0/1939641136 shutdown_connections 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 -- 172.21.15.110:0/1939641136 >> 172.21.15.110:0/1939641136 conn(0x7f51ec067750 msgr2=0x7f51ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 -- 172.21.15.110:0/1939641136 shutdown_connections 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.184+0000 7f51f2200640 1 -- 172.21.15.110:0/1939641136 wait complete. 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.185+0000 7f51f2200640 1 Processor -- start 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 -- start start 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 0x7f51ec148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec158100 0x7f51ec0ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec156d00 con 0x7f51ec157c90 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec155e50 con 0x7f51d0004780 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.186+0000 7f51f2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec169fe0 con 0x7f51ec158100 2024-08-17T02:29:45.190 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60240/0 (socket says 172.21.15.110:60240) 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 -- 172.21.15.110:0/2000479275 learned_addr learned my addr 172.21.15.110:0/2000479275 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51ebe00640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec158100 0x7f51ec0ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eb400640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 0x7f51ec148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 -- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec158100 msgr2=0x7f51ec0ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec158100 0x7f51ec0ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 -- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 msgr2=0x7f51ec148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 0x7f51ec148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 -- 172.21.15.110:0/2000479275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec1560f0 con 0x7f51ec157c90 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eb400640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 0x7f51ec148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.187+0000 7f51eaa00640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001860 tx=0x7f51d8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.188+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8033c60 con 0x7f51ec157c90 2024-08-17T02:29:45.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.188+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8033dc0 con 0x7f51ec157c90 2024-08-17T02:29:45.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.188+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec1563d0 con 0x7f51ec157c90 2024-08-17T02:29:45.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.188+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d803d6c0 con 0x7f51ec157c90 2024-08-17T02:29:45.192 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.188+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec156990 con 0x7f51ec157c90 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.189+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec156b50 con 0x7f51ec157c90 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.190+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f51d803daf0 con 0x7f51ec157c90 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.190+0000 7f51e2a00640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 0x7f51cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.191+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f51d80a2be0 con 0x7f51ec157c90 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.191+0000 7f51eb400640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 0x7f51cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.191+0000 7f51eb400640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 0x7f51cc067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009360 tx=0x7f51dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.196 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.195+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51d8070e10 con 0x7f51ec157c90 2024-08-17T02:29:45.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.365+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51ec156b50 con 0x7f51ec157c90 2024-08-17T02:29:45.367 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.366+0000 7f51e2a00640 1 -- 172.21.15.110:0/2000479275 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51d803dda0 con 0x7f51ec157c90 2024-08-17T02:29:45.367 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 msgr2=0x7f51cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 0x7f51cc067600 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009360 tx=0x7f51dc008040 comp rx=0 tx=0).stop 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 msgr2=0x7f51ec0ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f51d8001860 tx=0x7f51d8003000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 shutdown_connections 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f51cc065150 0x7f51cc067600 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51ec158100 0x7f51ec0ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ec157c90 0x7f51ec0ad0e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.370 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 --2- 172.21.15.110:0/2000479275 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51d0004780 0x7f51ec148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 >> 172.21.15.110:0/2000479275 conn(0x7f51ec067750 msgr2=0x7f51ec0afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 shutdown_connections 2024-08-17T02:29:45.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.368+0000 7f51f2200640 1 -- 172.21.15.110:0/2000479275 wait complete. 2024-08-17T02:29:45.385 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:45.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.532+0000 7f3c5c800640 1 Processor -- start 2024-08-17T02:29:45.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.532+0000 7f3c5c800640 1 -- start start 2024-08-17T02:29:45.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c54155a20 0x7f3c540adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c540ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c5406d7f0 0x7f3c5406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.535 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c540b0350 con 0x7f3c54155a20 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5406e1d0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c54156670 con 0x7f3c54155df0 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c59e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c54155a20 0x7f3c540adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c59e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c54155a20 0x7f3c540adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60244/0 (socket says 172.21.15.110:60244) 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c59e00640 1 -- 172.21.15.110:0/718527540 learned_addr learned my addr 172.21.15.110:0/718527540 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.533+0000 7f3c5a800640 1 --2- 172.21.15.110:0/718527540 >> v2:172.21.15.177:3300/0 conn(0x7f3c5406d7f0 0x7f3c5406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59400640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c540ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59e00640 1 -- 172.21.15.110:0/718527540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 msgr2=0x7f3c540ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59e00640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c540ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59e00640 1 -- 172.21.15.110:0/718527540 >> v2:172.21.15.177:3300/0 conn(0x7f3c5406d7f0 msgr2=0x7f3c5406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59e00640 1 --2- 172.21.15.110:0/718527540 >> v2:172.21.15.177:3300/0 conn(0x7f3c5406d7f0 0x7f3c5406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.534+0000 7f3c59e00640 1 -- 172.21.15.110:0/718527540 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5406e5e0 con 0x7f3c54155a20 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.535+0000 7f3c59e00640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c54155a20 0x7f3c540adf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c541565e0 tx=0x7f3c480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c71e4a380ec2097 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.535+0000 7f3c58a00640 1 -- 172.21.15.110:0/718527540 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4802add0 con 0x7f3c54155a20 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.535+0000 7f3c58a00640 1 -- 172.21.15.110:0/718527540 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48032440 con 0x7f3c54155a20 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.535+0000 7f3c58a00640 1 -- 172.21.15.110:0/718527540 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48032820 con 0x7f3c54155a20 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 -- 172.21.15.110:0/718527540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c54155a20 msgr2=0x7f3c540adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c54155a20 0x7f3c540adf10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c541565e0 tx=0x7f3c480091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 -- 172.21.15.110:0/718527540 shutdown_connections 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 --2- 172.21.15.110:0/718527540 >> v2:172.21.15.177:3300/0 conn(0x7f3c5406d7f0 0x7f3c5406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c540ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 --2- 172.21.15.110:0/718527540 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c54155a20 0x7f3c540adf10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 -- 172.21.15.110:0/718527540 >> 172.21.15.110:0/718527540 conn(0x7f3c540cb9b0 msgr2=0x7f3c540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 -- 172.21.15.110:0/718527540 shutdown_connections 2024-08-17T02:29:45.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.536+0000 7f3c5c800640 1 -- 172.21.15.110:0/718527540 wait complete. 2024-08-17T02:29:45.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.537+0000 7f3c5c800640 1 Processor -- start 2024-08-17T02:29:45.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.537+0000 7f3c5c800640 1 -- start start 2024-08-17T02:29:45.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 0x7f3c54146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.541 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c541542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c1b90 con 0x7f3c5406d7f0 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c0f80 con 0x7f3c54155a20 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c5c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c540c1260 con 0x7f3c54155df0 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.538+0000 7f3c59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60246/0 (socket says 172.21.15.110:60246) 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 -- 172.21.15.110:0/1218174548 learned_addr learned my addr 172.21.15.110:0/1218174548 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c5a800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c541542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 -- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 msgr2=0x7f3c541542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c541542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59400640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 0x7f3c54146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 -- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 msgr2=0x7f3c54146c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.542 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 0x7f3c54146c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 -- 172.21.15.110:0/1218174548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009450 con 0x7f3c5406d7f0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59400640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 0x7f3c54146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c59e00640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009210 tx=0x7f3c48032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.539+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031bb0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.540+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48031d30 con 0x7f3c5406d7f0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.540+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48031ea0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.540+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540c1540 con 0x7f3c5406d7f0 2024-08-17T02:29:45.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.540+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c541471d0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.541+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c54064db0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.541+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3c48039040 con 0x7f3c5406d7f0 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.542+0000 7f3c4d600640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 0x7f3c38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.543+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3c480a2300 con 0x7f3c5406d7f0 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.543+0000 7f3c59400640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 0x7f3c38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.544 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.543+0000 7f3c59400640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 0x7f3c38067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c44006e70 tx=0x7f3c44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.548 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.546+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3c48070320 con 0x7f3c5406d7f0 2024-08-17T02:29:45.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.759+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c5406deb0 con 0x7f3c5406d7f0 2024-08-17T02:29:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.759+0000 7f3c4d600640 1 -- 172.21.15.110:0/1218174548 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f3c48073940 con 0x7f3c5406d7f0 2024-08-17T02:29:45.761 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:45.761 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:45.761 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 msgr2=0x7f3c38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 0x7f3c38067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c44006e70 tx=0x7f3c44008040 comp rx=0 tx=0).stop 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 msgr2=0x7f3c540c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009210 tx=0x7f3c48032000 comp rx=0 tx=0).stop 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 shutdown_connections 2024-08-17T02:29:45.763 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3c38065150 0x7f3c38067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c54155df0 0x7f3c541542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c54155a20 0x7f3c54146c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 --2- 172.21.15.110:0/1218174548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c5406d7f0 0x7f3c540c09a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.761+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 >> 172.21.15.110:0/1218174548 conn(0x7f3c540cb9b0 msgr2=0x7f3c54158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.762+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 shutdown_connections 2024-08-17T02:29:45.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.762+0000 7f3c5c800640 1 -- 172.21.15.110:0/1218174548 wait complete. 2024-08-17T02:29:45.777 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:45.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.924+0000 7f8117200640 1 Processor -- start 2024-08-17T02:29:45.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.924+0000 7f8117200640 1 -- start start 2024-08-17T02:29:45.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8117200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8118159ca0 0x7f81180ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8117200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81180ca8a0 0x7f81180cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8117200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180cadc0 con 0x7f81180ccad0 2024-08-17T02:29:45.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8117200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180cd6e0 con 0x7f81180ca8a0 2024-08-17T02:29:45.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8117200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81180ccf70 con 0x7f8118159ca0 2024-08-17T02:29:45.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f810d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81180ca8a0 0x7f81180cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f810d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81180ca8a0 0x7f81180cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60256/0 (socket says 172.21.15.110:60256) 2024-08-17T02:29:45.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f810d400640 1 -- 172.21.15.110:0/247640288 learned_addr learned my addr 172.21.15.110:0/247640288 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8116800640 1 --1- 172.21.15.110:0/247640288 >> v1:172.21.15.110:6789/0 conn(0x7f81180ccad0 0x7f81180cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43062/0 (socket says 172.21.15.110:43062) 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.925+0000 7f8115e00640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8118159ca0 0x7f81180ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.926+0000 7f810d400640 1 -- 172.21.15.110:0/247640288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8118159ca0 msgr2=0x7f81180ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.926+0000 7f810d400640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8118159ca0 0x7f81180ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.926+0000 7f810d400640 1 -- 172.21.15.110:0/247640288 >> v1:172.21.15.110:6789/0 conn(0x7f81180ccad0 legacy=0x7f81180cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.926+0000 7f8115400640 1 -- 172.21.15.110:0/247640288 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649939114 0 0) 0x7f81180cadc0 con 0x7f81180ccad0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.926+0000 7f810d400640 1 -- 172.21.15.110:0/247640288 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180cb060 con 0x7f81180ca8a0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.927+0000 7f810d400640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ca8a0 0x7f81180cc590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8100009910 tx=0x7f81000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4e6788eba7da06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.927+0000 7f8115400640 1 -- 172.21.15.110:0/247640288 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810002ae40 con 0x7f81180ca8a0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.927+0000 7f8115400640 1 -- 172.21.15.110:0/247640288 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100032440 con 0x7f81180ca8a0 2024-08-17T02:29:45.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.927+0000 7f8115400640 1 -- 172.21.15.110:0/247640288 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000327e0 con 0x7f81180ca8a0 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.927+0000 7f8117200640 1 -- 172.21.15.110:0/247640288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ca8a0 msgr2=0x7f81180cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ca8a0 0x7f81180cc590 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8100009910 tx=0x7f81000091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 -- 172.21.15.110:0/247640288 shutdown_connections 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ca8a0 0x7f81180cc590 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 --2- 172.21.15.110:0/247640288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8118159ca0 0x7f81180ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 -- 172.21.15.110:0/247640288 >> 172.21.15.110:0/247640288 conn(0x7f8118098e00 msgr2=0x7f811806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 -- 172.21.15.110:0/247640288 shutdown_connections 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.928+0000 7f8117200640 1 -- 172.21.15.110:0/247640288 wait complete. 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.929+0000 7f8117200640 1 Processor -- start 2024-08-17T02:29:45.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.929+0000 7f8117200640 1 -- start start 2024-08-17T02:29:45.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81180ca8a0 0x7f8118158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 0x7f81180c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811809ae70 con 0x7f81180ccad0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c79a0 con 0x7f8118159ca0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f8117200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81180c7c80 con 0x7f81180ca8a0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f810d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f810d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60270/0 (socket says 172.21.15.110:60270) 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.930+0000 7f810d400640 1 -- 172.21.15.110:0/1770995856 learned_addr learned my addr 172.21.15.110:0/1770995856 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f8115e00640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81180ca8a0 0x7f8118158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f8116800640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 0x7f81180c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 -- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81180ca8a0 msgr2=0x7f8118158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81180ca8a0 0x7f8118158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 -- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 msgr2=0x7f81180c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:45.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 0x7f81180c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 -- 172.21.15.110:0/1770995856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8100009450 con 0x7f81180ccad0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f8116800640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 0x7f81180c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810d400640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8100035040 tx=0x7f8100032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100031bb0 con 0x7f81180ccad0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100031d30 con 0x7f81180ccad0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81180c7f60 con 0x7f81180ccad0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.931+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100031ea0 con 0x7f81180ccad0 2024-08-17T02:29:45.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.932+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811809d430 con 0x7f81180ccad0 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.932+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811809afe0 con 0x7f81180ccad0 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.933+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8100039040 con 0x7f81180ccad0 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.934+0000 7f810e000640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 0x7f80f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.934+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f810002ae40 con 0x7f81180ccad0 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.934+0000 7f8115e00640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 0x7f80f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:45.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.935+0000 7f8115e00640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 0x7f80f4067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8108009c80 tx=0x7f81080090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:45.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:45.938+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f81000707a0 con 0x7f81180ccad0 2024-08-17T02:29:46.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.113+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8118071050 con 0x7f81180ccad0 2024-08-17T02:29:46.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.114+0000 7f810e000640 1 -- 172.21.15.110:0/1770995856 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8100073dc0 con 0x7f81180ccad0 2024-08-17T02:29:46.115 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:46.115 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 msgr2=0x7f80f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 0x7f80f4067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8108009c80 tx=0x7f81080090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 msgr2=0x7f8118158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8100035040 tx=0x7f8100032000 comp rx=0 tx=0).stop 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 shutdown_connections 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f80f4065150 0x7f80f4067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8118159ca0 0x7f81180c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81180ccad0 0x7f8118158950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 --2- 172.21.15.110:0/1770995856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81180ca8a0 0x7f8118158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 >> 172.21.15.110:0/1770995856 conn(0x7f8118098e00 msgr2=0x7f81181570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 shutdown_connections 2024-08-17T02:29:46.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.116+0000 7f8117200640 1 -- 172.21.15.110:0/1770995856 wait complete. 2024-08-17T02:29:46.132 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:46.132 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:46.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.280+0000 7fc59a200640 1 Processor -- start 2024-08-17T02:29:46.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.281+0000 7fc59a200640 1 -- start start 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc59a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940b0270 0x7fc5941563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc59a200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc594157690 con 0x7fc594155900 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc59a200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc594156a80 con 0x7fc594158b30 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc59a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc594156d60 con 0x7fc5940b0270 2024-08-17T02:29:46.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc598e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc594155900 0x7fc594155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43064/0 (socket says 172.21.15.110:43064) 2024-08-17T02:29:46.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc598e00640 1 -- 172.21.15.110:0/4010649667 learned_addr learned my addr 172.21.15.110:0/4010649667 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc593e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940b0270 0x7fc5941563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.282+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541877011 0 0) 0x7fc594157690 con 0x7fc594155900 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc57c0034e0 con 0x7fc594155900 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511552507 0 0) 0x7fc594156a80 con 0x7fc594158b30 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc594157690 con 0x7fc594158b30 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570706737 0 0) 0x7fc57c0034e0 con 0x7fc594155900 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940b0270 msgr2=0x7fc5941563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940b0270 0x7fc5941563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 >> v1:172.21.15.177:6789/0 conn(0x7fc594158b30 legacy=0x7fc5940ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594157040 con 0x7fc594155900 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fc588001470 con 0x7fc594155900 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940b0270 0x7fc5941563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 >> v1:172.21.15.110:6789/0 conn(0x7fc594155900 legacy=0x7fc594155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc57c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc57c004780 0x7fc57c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc57c005130 0x7fc57c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594156d60 con 0x7fc57c003b90 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c00c020 con 0x7fc57c004780 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c00c1e0 con 0x7fc57c005130 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc598e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc57c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc593e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc57c004780 0x7fc57c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.283+0000 7fc599800640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc57c005130 0x7fc57c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.284+0000 7fc598e00640 1 -- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc57c005130 msgr2=0x7fc57c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.284+0000 7fc598e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc57c005130 0x7fc57c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.284+0000 7fc598e00640 1 -- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc57c004780 msgr2=0x7fc57c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.284+0000 7fc598e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc57c004780 0x7fc57c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.284+0000 7fc598e00640 1 -- 172.21.15.110:0/4010649667 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0034e0 con 0x7fc57c003b90 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc598e00640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc57c003f80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c2d0 tx=0x7fc594157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd8c98365cb4900 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588005960 con 0x7fc57c003b90 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58802d070 con 0x7fc57c003b90 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc593400640 1 -- 172.21.15.110:0/4010649667 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588005b20 con 0x7fc57c003b90 2024-08-17T02:29:46.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 -- 172.21.15.110:0/4010649667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 msgr2=0x7fc57c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 --2- 172.21.15.110:0/4010649667 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc57c003f80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c2d0 tx=0x7fc594157600 comp rx=0 tx=0).stop 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc599800640 1 -- 172.21.15.110:0/4010649667 reap_dead start 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 -- 172.21.15.110:0/4010649667 shutdown_connections 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 -- 172.21.15.110:0/4010649667 >> 172.21.15.110:0/4010649667 conn(0x7fc594067750 msgr2=0x7fc5940cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 -- 172.21.15.110:0/4010649667 shutdown_connections 2024-08-17T02:29:46.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.285+0000 7fc59a200640 1 -- 172.21.15.110:0/4010649667 wait complete. 2024-08-17T02:29:46.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.287+0000 7fc59a200640 1 Processor -- start 2024-08-17T02:29:46.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.287+0000 7fc59a200640 1 -- start start 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940ab180 0x7fc5940ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940a6810 0x7fc5940a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940abb30 con 0x7fc57c003b90 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940a7560 con 0x7fc5940a6810 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc59a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940a7840 con 0x7fc5940ab180 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc598e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc598e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60292/0 (socket says 172.21.15.110:60292) 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc598e00640 1 -- 172.21.15.110:0/2606267195 learned_addr learned my addr 172.21.15.110:0/2606267195 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc593e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940ab180 0x7fc5940ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.288+0000 7fc599800640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940a6810 0x7fc5940a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 -- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940ab180 msgr2=0x7fc5940ab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940ab180 0x7fc5940ab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 -- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940a6810 msgr2=0x7fc5940a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940a6810 0x7fc5940a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 -- 172.21.15.110:0/2606267195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5940a7b20 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc598e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc58802acb0 tx=0x7fc588033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588041070 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5880076e0 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588032430 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5940a7e00 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.289+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59413ee50 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.290+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc594071050 con 0x7fc57c003b90 2024-08-17T02:29:46.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.291+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc58802f030 con 0x7fc57c003b90 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.292+0000 7fc587e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 0x7fc574067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.292+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc5880a2240 con 0x7fc57c003b90 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.292+0000 7fc593e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 0x7fc574067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.292+0000 7fc593e00640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 0x7fc574067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc59416a5c0 tx=0x7fc5800090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.296+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc5880703d0 con 0x7fc57c003b90 2024-08-17T02:29:46.504 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.503+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc59406f480 con 0x7fc57c003b90 2024-08-17T02:29:46.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.504+0000 7fc587e00640 1 -- 172.21.15.110:0/2606267195 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7fc5880739f0 con 0x7fc57c003b90 2024-08-17T02:29:46.505 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:46.505 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:46.506 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 msgr2=0x7fc574067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 0x7fc574067630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc59416a5c0 tx=0x7fc5800090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 msgr2=0x7fc59413e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc58802acb0 tx=0x7fc588033000 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 shutdown_connections 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc574065180 0x7fc574067630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5940a6810 0x7fc5940a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5940ab180 0x7fc5940ab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 --2- 172.21.15.110:0/2606267195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc57c003b90 0x7fc59413e910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 >> 172.21.15.110:0/2606267195 conn(0x7fc594067750 msgr2=0x7fc594069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 shutdown_connections 2024-08-17T02:29:46.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.506+0000 7fc59a200640 1 -- 172.21.15.110:0/2606267195 wait complete. 2024-08-17T02:29:46.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:46.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.670+0000 7f1dcd000640 1 Processor -- start 2024-08-17T02:29:46.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.670+0000 7f1dcd000640 1 -- start start 2024-08-17T02:29:46.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.671+0000 7f1dcd000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 0x7f1dc80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.671+0000 7f1dcd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.671+0000 7f1dcd000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc80ab950 con 0x7f1dc80b03d0 2024-08-17T02:29:46.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.671+0000 7f1dcd000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80abc30 con 0x7f1dc80cc010 2024-08-17T02:29:46.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.671+0000 7f1dcd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80abf10 con 0x7f1dc80a98e0 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:49218/0 (socket says 172.21.15.110:49218) 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 -- 172.21.15.110:0/3906443479 learned_addr learned my addr 172.21.15.110:0/3906443479 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dc7400640 1 --2- 172.21.15.110:0/3906443479 >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 0x7f1dc80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 -- 172.21.15.110:0/3906443479 >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 msgr2=0x7f1dc80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 --2- 172.21.15.110:0/3906443479 >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 0x7f1dc80ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 -- 172.21.15.110:0/3906443479 >> v1:172.21.15.177:6789/0 conn(0x7f1dc80b03d0 legacy=0x7f1dc815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dbea00640 1 -- 172.21.15.110:0/3906443479 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80af970 con 0x7f1dc80a98e0 2024-08-17T02:29:46.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.672+0000 7f1dc7400640 1 --2- 172.21.15.110:0/3906443479 >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 0x7f1dc80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.673+0000 7f1dbea00640 1 --2- 172.21.15.110:0/3906443479 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009910 tx=0x7f1db00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10d75f29141f266 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dc6a00640 1 -- 172.21.15.110:0/3906443479 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db002adb0 con 0x7f1dc80a98e0 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dc6a00640 1 -- 172.21.15.110:0/3906443479 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db0032440 con 0x7f1dc80a98e0 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dc6a00640 1 -- 172.21.15.110:0/3906443479 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db0032820 con 0x7f1dc80a98e0 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 -- 172.21.15.110:0/3906443479 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 msgr2=0x7f1dc80afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3906443479 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009910 tx=0x7f1db00091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 -- 172.21.15.110:0/3906443479 shutdown_connections 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3906443479 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80a98e0 0x7f1dc80afe90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3906443479 >> v2:172.21.15.177:3300/0 conn(0x7f1dc80cc010 0x7f1dc80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 -- 172.21.15.110:0/3906443479 >> 172.21.15.110:0/3906443479 conn(0x7f1dc8067de0 msgr2=0x7f1dc80681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 -- 172.21.15.110:0/3906443479 shutdown_connections 2024-08-17T02:29:46.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.674+0000 7f1dcd000640 1 -- 172.21.15.110:0/3906443479 wait complete. 2024-08-17T02:29:46.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.676+0000 7f1dcd000640 1 Processor -- start 2024-08-17T02:29:46.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.676+0000 7f1dcd000640 1 -- start start 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc80b03d0 0x7f1dc80b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80cc010 0x7f1dc814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc8151e20 con 0x7f1dc80a98e0 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815b280 con 0x7f1dc80b03d0 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dcd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc815b500 con 0x7f1dc80cc010 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60294/0 (socket says 172.21.15.110:60294) 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 -- 172.21.15.110:0/3310644418 learned_addr learned my addr 172.21.15.110:0/3310644418 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dbea00640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc80b03d0 0x7f1dc80b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7e00640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80cc010 0x7f1dc814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 -- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80cc010 msgr2=0x7f1dc814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80cc010 0x7f1dc814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 -- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc80b03d0 msgr2=0x7f1dc80b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc80b03d0 0x7f1dc80b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.677+0000 7f1dc7400640 1 -- 172.21.15.110:0/3310644418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db8009390 con 0x7f1dc80a98e0 2024-08-17T02:29:46.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dc7400640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea70 tx=0x7f1db80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db800ca10 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db800cb70 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8013470 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db0009450 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.678+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc815bd70 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.679+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc8071050 con 0x7f1dc80a98e0 2024-08-17T02:29:46.681 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.680+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1db8013820 con 0x7f1dc80a98e0 2024-08-17T02:29:46.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.680+0000 7f1dbf400640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 0x7f1da4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:46.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.681+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1db8082760 con 0x7f1dc80a98e0 2024-08-17T02:29:46.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.681+0000 7f1dbea00640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 0x7f1da4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:46.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.681+0000 7f1dbea00640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 0x7f1da4067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:46.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.684+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1db8050830 con 0x7f1dc80a98e0 2024-08-17T02:29:46.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.895+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc80b1620 con 0x7f1dc80a98e0 2024-08-17T02:29:46.897 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.896+0000 7f1dbf400640 1 -- 172.21.15.110:0/3310644418 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4600 (secure 0 0 0) 0x7f1db8053e50 con 0x7f1dc80a98e0 2024-08-17T02:29:46.897 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:46.897 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/2529313109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2529313109},{"type":"v1","addr":"172.21.15.110:6835","nonce":2529313109}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4254,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/3399300308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3399300308},{"type":"v1","addr":"172.21.15.177:6833","nonce":3399300308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/695739222","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":695739222},{"type":"v1","addr":"172.21.15.110:6837","nonce":695739222}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:08.857999+0000","modified":"2024-08-17T02:29:12.480390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/3824023642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":3824023642},{"type":"v1","addr":"172.21.15.177:6835","nonce":3824023642}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:29:46.898 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 8 2024-08-17T02:29:46.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 msgr2=0x7f1da4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 0x7f1da4067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1db0034000 tx=0x7f1db0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 msgr2=0x7f1dc81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1db800ea70 tx=0x7f1db80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 shutdown_connections 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1da4065150 0x7f1da4067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dc80cc010 0x7f1dc814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dc80b03d0 0x7f1dc80b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 --2- 172.21.15.110:0/3310644418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc80a98e0 0x7f1dc81550e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 >> 172.21.15.110:0/3310644418 conn(0x7f1dc8067de0 msgr2=0x7f1dc806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 shutdown_connections 2024-08-17T02:29:46.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:46.898+0000 7f1dcd000640 1 -- 172.21.15.110:0/3310644418 wait complete. 2024-08-17T02:29:46.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.060+0000 7fbd0dc00640 1 Processor -- start 2024-08-17T02:29:47.062 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.060+0000 7fbd0dc00640 1 -- start start 2024-08-17T02:29:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd0dc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd08155180 0x7fbd080aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd0dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd08155550 0x7fbd080ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.063 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd0dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080afc10 con 0x7fbd0806e080 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd0dc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd080ae5b0 con 0x7fbd08155180 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd0dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd080af000 con 0x7fbd08155550 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd08155180 0x7fbd080aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd08155180 0x7fbd080aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60304/0 (socket says 172.21.15.110:60304) 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd07400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbd0806e080 0x7fbd0806e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43072/0 (socket says 172.21.15.110:43072) 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 -- 172.21.15.110:0/3732649781 learned_addr learned my addr 172.21.15.110:0/3732649781 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.064 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbcfe000640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd08155550 0x7fbd080ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 -- 172.21.15.110:0/3732649781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd08155550 msgr2=0x7fbd080ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd08155550 0x7fbd080ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 -- 172.21.15.110:0/3732649781 >> v1:172.21.15.110:6789/0 conn(0x7fbd0806e080 legacy=0x7fbd0806e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.062+0000 7fbd06a00640 1 -- 172.21.15.110:0/3732649781 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd080af2e0 con 0x7fbd08155180 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.063+0000 7fbd06a00640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155180 0x7fbd080aea20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800bbc0 tx=0x7fbcf800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb631e77c364159 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd06000640 1 -- 172.21.15.110:0/3732649781 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8031610 con 0x7fbd08155180 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd06000640 1 -- 172.21.15.110:0/3732649781 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8031770 con 0x7fbd08155180 2024-08-17T02:29:47.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd06000640 1 -- 172.21.15.110:0/3732649781 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8031b50 con 0x7fbd08155180 2024-08-17T02:29:47.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 -- 172.21.15.110:0/3732649781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155180 msgr2=0x7fbd080aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155180 0x7fbd080aea20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800bbc0 tx=0x7fbcf800b460 comp rx=0 tx=0).stop 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 -- 172.21.15.110:0/3732649781 shutdown_connections 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd08155550 0x7fbd080ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/3732649781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155180 0x7fbd080aea20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 -- 172.21.15.110:0/3732649781 >> 172.21.15.110:0/3732649781 conn(0x7fbd080cb9b0 msgr2=0x7fbd080cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 -- 172.21.15.110:0/3732649781 shutdown_connections 2024-08-17T02:29:47.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.064+0000 7fbd0dc00640 1 -- 172.21.15.110:0/3732649781 wait complete. 2024-08-17T02:29:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.066+0000 7fbd0dc00640 1 Processor -- start 2024-08-17T02:29:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.066+0000 7fbd0dc00640 1 -- start start 2024-08-17T02:29:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd0806e080 0x7fbd0814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 0x7fbd081584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd08152020 con 0x7fbd08155550 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814d460 con 0x7fbd08155180 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd0dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0814d740 con 0x7fbd0806e080 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60316/0 (socket says 172.21.15.110:60316) 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 -- 172.21.15.110:0/1153601648 learned_addr learned my addr 172.21.15.110:0/1153601648 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd06a00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd0806e080 0x7fbd0814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbcfe000640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 0x7fbd081584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 -- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd0806e080 msgr2=0x7fbd0814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd0806e080 0x7fbd0814ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 -- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 msgr2=0x7fbd081584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 0x7fbd081584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbd07400640 1 -- 172.21.15.110:0/1153601648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf800b700 con 0x7fbd08155550 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.067+0000 7fbcfe000640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 0x7fbd081584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbd07400640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c910 tx=0x7fbd00001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000cea0 con 0x7fbd08155550 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd00005d60 con 0x7fbd08155550 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0814da20 con 0x7fbd08155550 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0000a870 con 0x7fbd08155550 2024-08-17T02:29:47.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.068+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd08155bc0 con 0x7fbd08155550 2024-08-17T02:29:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.069+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd081521d0 con 0x7fbd08155550 2024-08-17T02:29:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.070+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbd0000aca0 con 0x7fbd08155550 2024-08-17T02:29:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.071+0000 7fbcfea00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.071+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbd00082210 con 0x7fbd08155550 2024-08-17T02:29:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.071+0000 7fbd06a00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.072+0000 7fbd06a00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 0x7fbce4067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8037000 tx=0x7fbcf803a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.075+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbd081521d0 con 0x7fbd08155550 2024-08-17T02:29:47.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.250+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd08064db0 con 0x7fbd08155550 2024-08-17T02:29:47.252 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.251+0000 7fbcfea00640 1 -- 172.21.15.110:0/1153601648 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fbd00050360 con 0x7fbd08155550 2024-08-17T02:29:47.253 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:47.253 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":22,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:10.465997+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:07.045438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:07.855922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 msgr2=0x7fbce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 0x7fbce4067600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8037000 tx=0x7fbcf803a000 comp rx=0 tx=0).stop 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 msgr2=0x7fbd08168000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000c910 tx=0x7fbd00001690 comp rx=0 tx=0).stop 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 shutdown_connections 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbce4065150 0x7fbce4067600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd08155550 0x7fbd08168000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd08155180 0x7fbd081584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 --2- 172.21.15.110:0/1153601648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd0806e080 0x7fbd0814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.253+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 >> 172.21.15.110:0/1153601648 conn(0x7fbd080cb9b0 msgr2=0x7fbd08068b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.254+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 shutdown_connections 2024-08-17T02:29:47.256 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.254+0000 7fbd0dc00640 1 -- 172.21.15.110:0/1153601648 wait complete. 2024-08-17T02:29:47.270 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:29:47.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.416+0000 7effbb000640 1 Processor -- start 2024-08-17T02:29:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.416+0000 7effbb000640 1 -- start start 2024-08-17T02:29:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effbb000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7effb4159ca0 0x7effb40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effbb000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effbb000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40cadc0 con 0x7effb40ccad0 2024-08-17T02:29:47.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effbb000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40cd6e0 con 0x7effb4159ca0 2024-08-17T02:29:47.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effbb000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40ccf70 con 0x7effb40ca8a0 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.417+0000 7effb9200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7effb4159ca0 0x7effb40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:49270/0 (socket says 172.21.15.110:49270) 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effba600640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7effb40ccad0 0x7effb40cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:45188/0 (socket says 172.21.15.110:45188) 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9200640 1 -- 172.21.15.110:0/2665090731 learned_addr learned my addr 172.21.15.110:0/2665090731 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9c00640 1 -- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 msgr2=0x7effb40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9c00640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9c00640 1 -- 172.21.15.110:0/2665090731 >> v1:172.21.15.177:6789/0 conn(0x7effb40ccad0 legacy=0x7effb40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9c00640 1 -- 172.21.15.110:0/2665090731 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb40cb060 con 0x7effb4159ca0 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb9200640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:29:47.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.418+0000 7effb3e00640 1 -- 172.21.15.110:0/2665090731 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870094033 0 0) 0x7effb40cadc0 con 0x7effb40ccad0 2024-08-17T02:29:47.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.419+0000 7effb9c00640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb40ca360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effa8009850 tx=0x7effa80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baaaaa9e4aa739fb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.419+0000 7effb3e00640 1 -- 172.21.15.110:0/2665090731 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa802ad90 con 0x7effb4159ca0 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.419+0000 7effb3e00640 1 -- 172.21.15.110:0/2665090731 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8032440 con 0x7effb4159ca0 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.419+0000 7effb3e00640 1 -- 172.21.15.110:0/2665090731 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa80327e0 con 0x7effb4159ca0 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 -- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 msgr2=0x7effb40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb40ca360 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effa8009850 tx=0x7effa80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 -- 172.21.15.110:0/2665090731 shutdown_connections 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ca8a0 0x7effb40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 --2- 172.21.15.110:0/2665090731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb40ca360 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 -- 172.21.15.110:0/2665090731 >> 172.21.15.110:0/2665090731 conn(0x7effb4098e00 msgr2=0x7effb406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 -- 172.21.15.110:0/2665090731 shutdown_connections 2024-08-17T02:29:47.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.420+0000 7effbb000640 1 -- 172.21.15.110:0/2665090731 wait complete. 2024-08-17T02:29:47.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.421+0000 7effbb000640 1 Processor -- start 2024-08-17T02:29:47.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.421+0000 7effbb000640 1 -- start start 2024-08-17T02:29:47.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ccad0 0x7effb40c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c4b50 con 0x7effb40ca8a0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c4870 con 0x7effb4159ca0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.422+0000 7effbb000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c5310 con 0x7effb40ccad0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60318/0 (socket says 172.21.15.110:60318) 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 -- 172.21.15.110:0/2549093961 learned_addr learned my addr 172.21.15.110:0/2549093961 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effba600640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9200640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ccad0 0x7effb40c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 -- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ccad0 msgr2=0x7effb40c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ccad0 0x7effb40c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 -- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 msgr2=0x7effb41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 -- 172.21.15.110:0/2549093961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009450 con 0x7effb40ca8a0 2024-08-17T02:29:47.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb9c00640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7effa8009360 tx=0x7effa8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8000d10 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa8031e00 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.423+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa803d670 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.424+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa8009390 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.424+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40c58d0 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.425+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40c5b10 con 0x7effb40ca8a0 2024-08-17T02:29:47.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.425+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7effa8039040 con 0x7effb40ca8a0 2024-08-17T02:29:47.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.426+0000 7effb0c00640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 0x7eff94067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.426+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effa80a23d0 con 0x7effb40ca8a0 2024-08-17T02:29:47.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.426+0000 7effb9200640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 0x7eff94067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.427+0000 7effb9200640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 0x7eff94067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7effa0009420 tx=0x7effa0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.430+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7effb40c5b10 con 0x7effb40ca8a0 2024-08-17T02:29:47.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.645+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7effb40c45c0 con 0x7effb40ca8a0 2024-08-17T02:29:47.647 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-08-17T02:29:47.646+0000 7f9668200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:29:47.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.650+0000 7effb0c00640 1 -- 172.21.15.110:0/2549093961 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7effa80703f0 con 0x7effb40ca8a0 2024-08-17T02:29:47.651 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:29:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 msgr2=0x7eff94067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 0x7eff94067600 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7effa0009420 tx=0x7effa0008040 comp rx=0 tx=0).stop 2024-08-17T02:29:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 msgr2=0x7effb4155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.654 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7effa8009360 tx=0x7effa8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 shutdown_connections 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7eff94065150 0x7eff94067600 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effb4159ca0 0x7effb41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effb40ccad0 0x7effb40c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 --2- 172.21.15.110:0/2549093961 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effb40ca8a0 0x7effb4155380 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 >> 172.21.15.110:0/2549093961 conn(0x7effb4098e00 msgr2=0x7effb4157240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 shutdown_connections 2024-08-17T02:29:47.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.652+0000 7effbb000640 1 -- 172.21.15.110:0/2549093961 wait complete. 2024-08-17T02:29:47.657 INFO:tasks.ceph.mds.d.smithi177.stderr: -1964> 2024-08-17T02:29:13.516+0000 7f1888a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:29:47.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:29:47.698 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-08-17T02:29:47.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.815+0000 7fdae1800640 1 Processor -- start 2024-08-17T02:29:47.817 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.815+0000 7fdae1800640 1 -- start start 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 0x7fdadc06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdadc06dcf0 0x7fdadc158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc156770 con 0x7fdadc06dcf0 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc06e130 con 0x7fdadc0af6b0 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdae1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc155b60 con 0x7fdadc0af2e0 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdadc06dcf0 0x7fdadc158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdadc06dcf0 0x7fdadc158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60322/0 (socket says 172.21.15.110:60322) 2024-08-17T02:29:47.819 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 -- 172.21.15.110:0/2889680263 learned_addr learned my addr 172.21.15.110:0/2889680263 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadaa00640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdad2000640 1 --2- 172.21.15.110:0/2889680263 >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 0x7fdadc06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 -- 172.21.15.110:0/2889680263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 msgr2=0x7fdadc0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 -- 172.21.15.110:0/2889680263 >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 msgr2=0x7fdadc06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 --2- 172.21.15.110:0/2889680263 >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 0x7fdadc06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 -- 172.21.15.110:0/2889680263 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc155e40 con 0x7fdadc06dcf0 2024-08-17T02:29:47.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdad2000640 1 --2- 172.21.15.110:0/2889680263 >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 0x7fdadc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.818+0000 7fdadb400640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc06dcf0 0x7fdadc158d50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdadc067b50 tx=0x7fdad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eadad039dbe24d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdada000640 1 -- 172.21.15.110:0/2889680263 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4031400 con 0x7fdadc06dcf0 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdada000640 1 -- 172.21.15.110:0/2889680263 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad402d050 con 0x7fdadc06dcf0 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdada000640 1 -- 172.21.15.110:0/2889680263 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad40317d0 con 0x7fdadc06dcf0 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 -- 172.21.15.110:0/2889680263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc06dcf0 msgr2=0x7fdadc158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc06dcf0 0x7fdadc158d50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdadc067b50 tx=0x7fdad4009840 comp rx=0 tx=0).stop 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 -- 172.21.15.110:0/2889680263 shutdown_connections 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc06dcf0 0x7fdadc158d50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 --2- 172.21.15.110:0/2889680263 >> v2:172.21.15.177:3300/0 conn(0x7fdadc0af6b0 0x7fdadc06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 --2- 172.21.15.110:0/2889680263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc0b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.819+0000 7fdae1800640 1 -- 172.21.15.110:0/2889680263 >> 172.21.15.110:0/2889680263 conn(0x7fdadc067750 msgr2=0x7fdadc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:47.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.820+0000 7fdae1800640 1 -- 172.21.15.110:0/2889680263 shutdown_connections 2024-08-17T02:29:47.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.820+0000 7fdae1800640 1 -- 172.21.15.110:0/2889680263 wait complete. 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.822+0000 7fdae1800640 1 Processor -- start 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.822+0000 7fdae1800640 1 -- start start 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc06dcf0 0x7fdadc142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc14aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc168b50 con 0x7fdadc0af6b0 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc142e90 con 0x7fdadc06dcf0 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc143170 con 0x7fdadc0af2e0 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60336/0 (socket says 172.21.15.110:60336) 2024-08-17T02:29:47.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 -- 172.21.15.110:0/708183724 learned_addr learned my addr 172.21.15.110:0/708183724 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadaa00640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc06dcf0 0x7fdadc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdad2000640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc14aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 -- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 msgr2=0x7fdadc14aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc14aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 -- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc06dcf0 msgr2=0x7fdadc142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc06dcf0 0x7fdadc142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 -- 172.21.15.110:0/708183724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009ae0 con 0x7fdadc0af6b0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdad2000640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc14aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdadb400640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009f50 tx=0x7fdad4034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4007170 con 0x7fdadc0af6b0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad4008e50 con 0x7fdadc0af6b0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad403b660 con 0x7fdadc0af6b0 2024-08-17T02:29:47.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc143450 con 0x7fdadc0af6b0 2024-08-17T02:29:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.823+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc143a10 con 0x7fdadc0af6b0 2024-08-17T02:29:47.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.824+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc143c30 con 0x7fdadc0af6b0 2024-08-17T02:29:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.825+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdad4038050 con 0x7fdadc0af6b0 2024-08-17T02:29:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.826+0000 7fdad2a00640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 0x7fdab8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.826+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fdad40a2fe0 con 0x7fdadc0af6b0 2024-08-17T02:29:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.826+0000 7fdadaa00640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 0x7fdab8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:47.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.826+0000 7fdadaa00640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 0x7fdab8067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d20 tx=0x7fdacc0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:47.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:47.830+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdad40710a0 con 0x7fdadc0af6b0 2024-08-17T02:29:48.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.039+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdadc071050 con 0x7fdadc0af6b0 2024-08-17T02:29:48.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.651+0000 7fdad2a00640 1 -- 172.21.15.110:0/708183724 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdad40746c0 con 0x7fdadc0af6b0 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 msgr2=0x7fdab8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 0x7fdab8067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009d20 tx=0x7fdacc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 msgr2=0x7fdadc143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009f50 tx=0x7fdad4034000 comp rx=0 tx=0).stop 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 shutdown_connections 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fdab8065150 0x7fdab8067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdadc0af6b0 0x7fdadc143f30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdadc0af2e0 0x7fdadc14aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 --2- 172.21.15.110:0/708183724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdadc06dcf0 0x7fdadc142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 >> 172.21.15.110:0/708183724 conn(0x7fdadc067750 msgr2=0x7fdadc0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 shutdown_connections 2024-08-17T02:29:48.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.653+0000 7fdae1800640 1 -- 172.21.15.110:0/708183724 wait complete. 2024-08-17T02:29:48.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:29:48.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.820+0000 7fc1c3e00640 1 Processor -- start 2024-08-17T02:29:48.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.820+0000 7fc1c3e00640 1 -- start start 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.821+0000 7fc1c3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1bc06e5f0 0x7fc1bc0c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.821+0000 7fc1c3e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0ae9b0 con 0x7fc1bc156c60 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.821+0000 7fc1c3e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1bc0ab320 con 0x7fc1bc156890 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.821+0000 7fc1c3e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1bc0aa730 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c1e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc1bc156c60 0x7fc1bc0ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43082/0 (socket says 172.21.15.110:43082) 2024-08-17T02:29:48.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c1e00640 1 -- 172.21.15.110:0/1466948806 learned_addr learned my addr 172.21.15.110:0/1466948806 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:48.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c0a00640 1 --2- 172.21.15.110:0/1466948806 >> v2:172.21.15.177:3300/0 conn(0x7fc1bc06e5f0 0x7fc1bc0c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715338411 0 0) 0x7fc1bc0ae9b0 con 0x7fc1bc156c60 2024-08-17T02:29:48.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a40034e0 con 0x7fc1bc156c60 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397170262 0 0) 0x7fc1bc0ab320 con 0x7fc1bc156890 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc0ae9b0 con 0x7fc1bc156890 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876503337 0 0) 0x7fc1a40034e0 con 0x7fc1bc156c60 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c0a00640 1 -- 172.21.15.110:0/1466948806 >> v1:172.21.15.177:6789/0 conn(0x7fc1bc156890 legacy=0x7fc1bc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c0a00640 1 -- 172.21.15.110:0/1466948806 >> v1:172.21.15.110:6789/0 conn(0x7fc1bc156c60 legacy=0x7fc1bc0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.822+0000 7fc1c0a00640 1 -- 172.21.15.110:0/1466948806 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc0aa9f0 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.823+0000 7fc1c0a00640 1 --2- 172.21.15.110:0/1466948806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc06e5f0 0x7fc1bc0c8130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009850 tx=0x7fc1a80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17f117ce4adfe767 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b40017f0 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a802aa50 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1bbe00640 1 -- 172.21.15.110:0/1466948806 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a802adf0 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 -- 172.21.15.110:0/1466948806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc06e5f0 msgr2=0x7fc1bc0c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/1466948806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc06e5f0 0x7fc1bc0c8130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8009850 tx=0x7fc1a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 -- 172.21.15.110:0/1466948806 shutdown_connections 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/1466948806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc06e5f0 0x7fc1bc0c8130 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 -- 172.21.15.110:0/1466948806 >> 172.21.15.110:0/1466948806 conn(0x7fc1bc067750 msgr2=0x7fc1bc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 -- 172.21.15.110:0/1466948806 shutdown_connections 2024-08-17T02:29:48.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.824+0000 7fc1c3e00640 1 -- 172.21.15.110:0/1466948806 wait complete. 2024-08-17T02:29:48.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.826+0000 7fc1c3e00640 1 Processor -- start 2024-08-17T02:29:48.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.826+0000 7fc1c3e00640 1 -- start start 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1bc06e5f0 0x7fc1bc15ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc156890 0x7fc1bc168c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc15b180 con 0x7fc1bc156c60 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc157c00 con 0x7fc1bc156890 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc1572d0 con 0x7fc1bc06e5f0 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60350/0 (socket says 172.21.15.110:60350) 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 -- 172.21.15.110:0/727908576 learned_addr learned my addr 172.21.15.110:0/727908576 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c0a00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc156890 0x7fc1bc168c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1400640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1bc06e5f0 0x7fc1bc15ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 -- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1bc06e5f0 msgr2=0x7fc1bc15ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1bc06e5f0 0x7fc1bc15ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 -- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc156890 msgr2=0x7fc1bc168c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc156890 0x7fc1bc168c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.827+0000 7fc1c1e00640 1 -- 172.21.15.110:0/727908576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a8009390 con 0x7fc1bc156c60 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1c1e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cc10 tx=0x7fc1b4007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b400ab60 con 0x7fc1bc156c60 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b400ace0 con 0x7fc1bc156c60 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4004d70 con 0x7fc1bc156c60 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc1575b0 con 0x7fc1bc156c60 2024-08-17T02:29:48.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.828+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc0ac930 con 0x7fc1bc156c60 2024-08-17T02:29:48.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.829+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc0710c0 con 0x7fc1bc156c60 2024-08-17T02:29:48.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.830+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc1b4007360 con 0x7fc1bc156c60 2024-08-17T02:29:48.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.831+0000 7fc1b8c00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 0x7fc19c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:48.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.831+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fc1b4081d40 con 0x7fc1bc156c60 2024-08-17T02:29:48.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.831+0000 7fc1c1400640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 0x7fc19c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:48.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.832+0000 7fc1c1400640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 0x7fc19c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00037e0 tx=0x7fc1b0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:48.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:48.835+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc1b404fd90 con 0x7fc1bc156c60 2024-08-17T02:29:49.009 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.007+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1bc157d40 con 0x7fc1bc156c60 2024-08-17T02:29:49.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.657+0000 7fc1b8c00640 1 -- 172.21.15.110:0/727908576 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc1b4018020 con 0x7fc1bc156c60 2024-08-17T02:29:49.658 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:29:49.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.662+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 msgr2=0x7fc19c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.662+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 0x7fc19c067600 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00037e0 tx=0x7fc1b0009040 comp rx=0 tx=0).stop 2024-08-17T02:29:49.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 msgr2=0x7fc1bc0a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc1b400cc10 tx=0x7fc1b4007d60 comp rx=0 tx=0).stop 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 shutdown_connections 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc19c065150 0x7fc19c067600 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1bc156c60 0x7fc1bc0a9b10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1bc156890 0x7fc1bc168c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 --2- 172.21.15.110:0/727908576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1bc06e5f0 0x7fc1bc15ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 >> 172.21.15.110:0/727908576 conn(0x7fc1bc067750 msgr2=0x7fc1bc0af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.663+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 shutdown_connections 2024-08-17T02:29:49.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.664+0000 7fc1c3e00640 1 -- 172.21.15.110:0/727908576 wait complete. 2024-08-17T02:29:49.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:29:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.834+0000 7f31f4200640 1 Processor -- start 2024-08-17T02:29:49.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.834+0000 7f31f4200640 1 -- start start 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.835+0000 7f31f4200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 0x7f31ec06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f4200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0ae9b0 con 0x7f31ec156c60 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f4200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0ab320 con 0x7f31ec0c8840 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f4200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0aa730 con 0x7f31ec156890 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f0e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f31ec156c60 0x7f31ec0c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43090/0 (socket says 172.21.15.110:43090) 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f0e00640 1 -- 172.21.15.110:0/810712111 learned_addr learned my addr 172.21.15.110:0/810712111 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:49.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31f1800640 1 --2- 172.21.15.110:0/810712111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 0x7f31ec06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182277155 0 0) 0x7f31ec0ae9b0 con 0x7f31ec156c60 2024-08-17T02:29:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.836+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d40034e0 con 0x7f31ec156c60 2024-08-17T02:29:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310573624 0 0) 0x7f31ec0ab320 con 0x7f31ec0c8840 2024-08-17T02:29:49.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec0ae9b0 con 0x7f31ec0c8840 2024-08-17T02:29:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2580089202 0 0) 0x7f31d40034e0 con 0x7f31ec156c60 2024-08-17T02:29:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31f1800640 1 -- 172.21.15.110:0/810712111 >> v1:172.21.15.177:6789/0 conn(0x7f31ec0c8840 legacy=0x7f31ec0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31f1800640 1 -- 172.21.15.110:0/810712111 >> v1:172.21.15.110:6789/0 conn(0x7f31ec156c60 legacy=0x7f31ec0c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.837+0000 7f31f1800640 1 -- 172.21.15.110:0/810712111 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0aa9f0 con 0x7f31ec156890 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31f1800640 1 --2- 172.21.15.110:0/810712111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 0x7f31ec06dee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009880 tx=0x7f31e00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a6bfdea26282b1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80013f0 con 0x7f31ec156890 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e002aa30 con 0x7f31ec156890 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31ebe00640 1 -- 172.21.15.110:0/810712111 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e002add0 con 0x7f31ec156890 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31f4200640 1 -- 172.21.15.110:0/810712111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 msgr2=0x7f31ec06dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.838+0000 7f31f4200640 1 --2- 172.21.15.110:0/810712111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 0x7f31ec06dee0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009880 tx=0x7f31e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.839+0000 7f31f4200640 1 -- 172.21.15.110:0/810712111 shutdown_connections 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.839+0000 7f31f4200640 1 --2- 172.21.15.110:0/810712111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec156890 0x7f31ec06dee0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.839+0000 7f31f4200640 1 -- 172.21.15.110:0/810712111 >> 172.21.15.110:0/810712111 conn(0x7f31ec067750 msgr2=0x7f31ec06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.839+0000 7f31f4200640 1 -- 172.21.15.110:0/810712111 shutdown_connections 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.839+0000 7f31f4200640 1 -- 172.21.15.110:0/810712111 wait complete. 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.840+0000 7f31f4200640 1 Processor -- start 2024-08-17T02:29:49.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.840+0000 7f31f4200640 1 -- start start 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec0c8840 0x7f31ec141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31ec156890 0x7f31ec0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a7680 con 0x7f31ec156c60 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a6a70 con 0x7f31ec156890 2024-08-17T02:29:49.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f4200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a6d50 con 0x7f31ec0c8840 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60358/0 (socket says 172.21.15.110:60358) 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f2200640 1 -- 172.21.15.110:0/2327797584 learned_addr learned my addr 172.21.15.110:0/2327797584 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f1800640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec0c8840 0x7f31ec141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.841+0000 7f31f0e00640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31ec156890 0x7f31ec0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 -- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec0c8840 msgr2=0x7f31ec141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec0c8840 0x7f31ec141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 -- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31ec156890 msgr2=0x7f31ec0a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31ec156890 0x7f31ec0a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 -- 172.21.15.110:0/2327797584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009390 con 0x7f31ec156c60 2024-08-17T02:29:49.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f2200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c910 tx=0x7f31e40026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400cea0 con 0x7f31ec156c60 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e400a850 con 0x7f31ec156c60 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400ac70 con 0x7f31ec156c60 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec0a7030 con 0x7f31ec156c60 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.842+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec1423d0 con 0x7f31ec156c60 2024-08-17T02:29:49.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.843+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0a7830 con 0x7f31ec156c60 2024-08-17T02:29:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.844+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e4012630 con 0x7f31ec156c60 2024-08-17T02:29:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.845+0000 7f31e8c00640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.845+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f31e4082540 con 0x7f31ec156c60 2024-08-17T02:29:49.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.845+0000 7f31f1800640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:49.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.846+0000 7f31f1800640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 0x7f31cc067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:49.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:49.849+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31ec0a7830 con 0x7f31ec156c60 2024-08-17T02:29:50.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.021+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31ec0710c0 con 0x7f31ec156c60 2024-08-17T02:29:50.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.662+0000 7f31e8c00640 1 -- 172.21.15.110:0/2327797584 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f31e4054200 con 0x7f31ec156c60 2024-08-17T02:29:50.663 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2024-08-17T02:29:50.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 msgr2=0x7f31cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 0x7f31cc067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e0032000 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 msgr2=0x7f31ec0a9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c910 tx=0x7f31e40026f0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 shutdown_connections 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31ec156c60 0x7f31ec0a9280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31ec156890 0x7f31ec0a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 --2- 172.21.15.110:0/2327797584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31ec0c8840 0x7f31ec141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 >> 172.21.15.110:0/2327797584 conn(0x7f31ec067750 msgr2=0x7f31ec0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.666+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 shutdown_connections 2024-08-17T02:29:50.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.667+0000 7f31f4200640 1 -- 172.21.15.110:0/2327797584 wait complete. 2024-08-17T02:29:50.684 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:29:50.684 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:29:50.685 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:29:50.685 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:50.685 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:29:50.685 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:29:50.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:29:50.685 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:50.685 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:29:50.686 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:29:50.686 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:29:50.686 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:50.686 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:29:50.686 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:29:50.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:29:50.686 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:50.700 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:29:50.700 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:29:50.701 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:29:50.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:29:50.703 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:29:50.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:29:50.704 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:29:50.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:29:50.745 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:29:50.745 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:50.748 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:29:50.748 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:50.748 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:29:50.749 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:50.750 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:29:50.750 DEBUG:teuthology.parallel:result is None 2024-08-17T02:29:50.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:29:50.872 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2024-08-17T02:29:50.873 INFO:tasks.ceph.mds.c.smithi110.stdout:starting mds.c at 2024-08-17T02:29:50.878 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-08-17T02:29:50.879 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-08-17T02:29:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.914+0000 7f75a2a00640 1 Processor -- start 2024-08-17T02:29:50.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.914+0000 7f75a2a00640 1 -- start start 2024-08-17T02:29:50.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.915+0000 7f75a2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f759c0b0610 0x7f759c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.915+0000 7f75a2a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0b1690 con 0x7f759c15d830 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.915+0000 7f75a2a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0ae4a0 con 0x7f759c15e140 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.915+0000 7f75a2a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c06e8c0 con 0x7f759c0b0610 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f759c15d830 0x7f759c06e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43106/0 (socket says 172.21.15.110:43106) 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759be00640 1 -- 172.21.15.110:0/304021278 learned_addr learned my addr 172.21.15.110:0/304021278 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759b400640 1 --2- 172.21.15.110:0/304021278 >> v2:172.21.15.110:3300/0 conn(0x7f759c0b0610 0x7f759c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759aa00640 1 -- 172.21.15.110:0/304021278 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146482291 0 0) 0x7f759c0b1690 con 0x7f759c15d830 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759aa00640 1 -- 172.21.15.110:0/304021278 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75800034e0 con 0x7f759c15d830 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759b400640 1 -- 172.21.15.110:0/304021278 >> v1:172.21.15.177:6789/0 conn(0x7f759c15e140 legacy=0x7f759c166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759b400640 1 -- 172.21.15.110:0/304021278 >> v1:172.21.15.110:6789/0 conn(0x7f759c15d830 legacy=0x7f759c06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.916+0000 7f759b400640 1 -- 172.21.15.110:0/304021278 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c15b200 con 0x7f759c0b0610 2024-08-17T02:29:50.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.917+0000 7f759b400640 1 --2- 172.21.15.110:0/304021278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c15dc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7588009850 tx=0x7f75880090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e89eb21c7446d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.917+0000 7f759aa00640 1 -- 172.21.15.110:0/304021278 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758802ae20 con 0x7f759c0b0610 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.917+0000 7f759aa00640 1 -- 172.21.15.110:0/304021278 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7588032440 con 0x7f759c0b0610 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.917+0000 7f759aa00640 1 -- 172.21.15.110:0/304021278 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75880327c0 con 0x7f759c0b0610 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 -- 172.21.15.110:0/304021278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 msgr2=0x7f759c15dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 --2- 172.21.15.110:0/304021278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c15dc00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7588009850 tx=0x7f75880090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 -- 172.21.15.110:0/304021278 shutdown_connections 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 --2- 172.21.15.110:0/304021278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c15dc00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 -- 172.21.15.110:0/304021278 >> 172.21.15.110:0/304021278 conn(0x7f759c0cb9b0 msgr2=0x7f759c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 -- 172.21.15.110:0/304021278 shutdown_connections 2024-08-17T02:29:50.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.918+0000 7f75a2a00640 1 -- 172.21.15.110:0/304021278 wait complete. 2024-08-17T02:29:50.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.920+0000 7f75a2a00640 1 Processor -- start 2024-08-17T02:29:50.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.920+0000 7f75a2a00640 1 -- start start 2024-08-17T02:29:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.920+0000 7f75a2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.920+0000 7f75a2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f759c15d830 0x7f759c16e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f75a2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f759c15e140 0x7f759c0accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f75a2a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c16e590 con 0x7f759c0b0610 2024-08-17T02:29:50.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f75a2a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c16eb10 con 0x7f759c15e140 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f75a2a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c16edf0 con 0x7f759c15d830 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60398/0 (socket says 172.21.15.110:60398) 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 -- 172.21.15.110:0/394500989 learned_addr learned my addr 172.21.15.110:0/394500989 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759b400640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f759c15d830 0x7f759c16e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f75a0a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f759c15e140 0x7f759c0accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 -- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f759c15d830 msgr2=0x7f759c16e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f759c15d830 0x7f759c16e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 -- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f759c15e140 msgr2=0x7f759c0accc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f759c15e140 0x7f759c0accc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.921+0000 7f759be00640 1 -- 172.21.15.110:0/394500989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7588009390 con 0x7f759c0b0610 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f759be00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c5b0 tx=0x7f758c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c005aa0 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c005c00 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0070f0 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c16f0d0 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.922+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c16f690 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.923+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c16f8b0 con 0x7f759c0b0610 2024-08-17T02:29:50.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.924+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f758c007520 con 0x7f759c0b0610 2024-08-17T02:29:50.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.925+0000 7f7593400640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 0x7f757c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:50.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.925+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f758c081ae0 con 0x7f759c0b0610 2024-08-17T02:29:50.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.925+0000 7f759b400640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 0x7f757c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:50.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.926+0000 7f759b400640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 0x7f757c067630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7588034000 tx=0x7f7588032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:50.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:50.929+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f758c04ff30 con 0x7f759c0b0610 2024-08-17T02:29:51.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.114+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f759c064db0 con 0x7f759c0b0610 2024-08-17T02:29:51.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.675+0000 7f7593400640 1 -- 172.21.15.110:0/394500989 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f758c053550 con 0x7f759c0b0610 2024-08-17T02:29:51.676 INFO:teuthology.orchestra.run.smithi110.stderr: removed all blocklist entries 2024-08-17T02:29:51.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.678+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 msgr2=0x7f757c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.678+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 0x7f757c067630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7588034000 tx=0x7f7588032000 comp rx=0 tx=0).stop 2024-08-17T02:29:51.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.678+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 msgr2=0x7f759c16b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.679 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.678+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f758c00c5b0 tx=0x7f758c007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 shutdown_connections 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f757c065180 0x7f757c067630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f759c15e140 0x7f759c0accc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f759c15d830 0x7f759c16e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 --2- 172.21.15.110:0/394500989 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759c0b0610 0x7f759c16b210 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 >> 172.21.15.110:0/394500989 conn(0x7f759c0cb9b0 msgr2=0x7f759c15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 shutdown_connections 2024-08-17T02:29:51.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.679+0000 7f75a2a00640 1 -- 172.21.15.110:0/394500989 wait complete. 2024-08-17T02:29:51.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:29:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.844+0000 7fe84dc00640 1 Processor -- start 2024-08-17T02:29:51.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.844+0000 7fe84dc00640 1 -- start start 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe84dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe848158f80 0x7fe8480ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe84dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8480cb560 con 0x7fe8480cf280 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe84dc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8480ce6e0 con 0x7fe848159350 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe84dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8480cf7e0 con 0x7fe848158f80 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe847400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe8480cf280 0x7fe8480cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43108/0 (socket says 172.21.15.110:43108) 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.845+0000 7fe847400640 1 -- 172.21.15.110:0/1001532913 learned_addr learned my addr 172.21.15.110:0/1001532913 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:51.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe846a00640 1 --2- 172.21.15.110:0/1001532913 >> v2:172.21.15.177:3300/0 conn(0x7fe848158f80 0x7fe8480ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341852390 0 0) 0x7fe8480cb560 con 0x7fe8480cf280 2024-08-17T02:29:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c0034e0 con 0x7fe8480cf280 2024-08-17T02:29:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735784254 0 0) 0x7fe8480ce6e0 con 0x7fe848159350 2024-08-17T02:29:51.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8480cb560 con 0x7fe848159350 2024-08-17T02:29:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe846a00640 1 -- 172.21.15.110:0/1001532913 >> v1:172.21.15.177:6789/0 conn(0x7fe848159350 legacy=0x7fe8480cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe846a00640 1 -- 172.21.15.110:0/1001532913 >> v1:172.21.15.110:6789/0 conn(0x7fe8480cf280 legacy=0x7fe8480cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.846+0000 7fe846a00640 1 -- 172.21.15.110:0/1001532913 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8480cfac0 con 0x7fe848158f80 2024-08-17T02:29:51.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.847+0000 7fe846a00640 1 --2- 172.21.15.110:0/1001532913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848158f80 0x7fe8480ca330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe838009850 tx=0x7fe8380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187c0de70ef9948a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.847+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83802ae20 con 0x7fe848158f80 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.847+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838032440 con 0x7fe848158f80 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.847+0000 7fe845600640 1 -- 172.21.15.110:0/1001532913 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380327e0 con 0x7fe848158f80 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 -- 172.21.15.110:0/1001532913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848158f80 msgr2=0x7fe8480ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1001532913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848158f80 0x7fe8480ca330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe838009850 tx=0x7fe8380090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 -- 172.21.15.110:0/1001532913 shutdown_connections 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1001532913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848158f80 0x7fe8480ca330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 -- 172.21.15.110:0/1001532913 >> 172.21.15.110:0/1001532913 conn(0x7fe8480cfd90 msgr2=0x7fe8480d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 -- 172.21.15.110:0/1001532913 shutdown_connections 2024-08-17T02:29:51.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.848+0000 7fe84dc00640 1 -- 172.21.15.110:0/1001532913 wait complete. 2024-08-17T02:29:51.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.849+0000 7fe84dc00640 1 Processor -- start 2024-08-17T02:29:51.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 -- start start 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 0x7fe8480b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 0x7fe8480b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8480cacb0 con 0x7fe8480cf280 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8480c9c10 con 0x7fe848159350 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.850+0000 7fe84dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8480c9ef0 con 0x7fe848158f80 2024-08-17T02:29:51.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60400/0 (socket says 172.21.15.110:60400) 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 -- 172.21.15.110:0/1418820676 learned_addr learned my addr 172.21.15.110:0/1418820676 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe847400640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 0x7fe8480b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 -- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 msgr2=0x7fe8480b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846000640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 0x7fe8480b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 0x7fe8480b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 -- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 msgr2=0x7fe8480b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 0x7fe8480b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 -- 172.21.15.110:0/1418820676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838009390 con 0x7fe8480cf280 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe847400640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 0x7fe8480b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846000640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 0x7fe8480b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.851+0000 7fe846a00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe838009360 tx=0x7fe838032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.852+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838000c40 con 0x7fe8480cf280 2024-08-17T02:29:51.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.852+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838031a60 con 0x7fe8480cf280 2024-08-17T02:29:51.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.852+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838031e00 con 0x7fe8480cf280 2024-08-17T02:29:51.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.852+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8480ca1d0 con 0x7fe8480cf280 2024-08-17T02:29:51.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.852+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8480ca790 con 0x7fe8480cf280 2024-08-17T02:29:51.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.853+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848064db0 con 0x7fe8480cf280 2024-08-17T02:29:51.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.854+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe838039040 con 0x7fe8480cf280 2024-08-17T02:29:51.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.854+0000 7fe83e000640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 0x7fe828067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:51.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.854+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe8380a1c20 con 0x7fe8480cf280 2024-08-17T02:29:51.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.855+0000 7fe846000640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 0x7fe828067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:51.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.855+0000 7fe846000640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 0x7fe828067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe834007fd0 tx=0x7fe834009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:51.859 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:51.858+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe838070030 con 0x7fe8480cf280 2024-08-17T02:29:52.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.093+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe848089750 con 0x7fe8480cf280 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.093+0000 7fe83e000640 1 -- 172.21.15.110:0/1418820676 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe838073650 con 0x7fe8480cf280 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "auth_dump": [ 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.a", 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmNHq1BxAAUU2f4oXpWtnV2z1C5cHBew==", 2024-08-17T02:29:52.094 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.b", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmpdV1GhAAAFqeamv2ceNs1jEgU5uq3A==", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.095 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.c", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmnecHERAAwyQas+64gOqZtYBmQ1WzjA==", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2024-08-17T02:29:52.096 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mds.d", 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmZqvoIxAAeeIeIatn2IK91DPOCUtpRQ==", 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2024-08-17T02:29:52.097 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.0", 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDDCsBmbCGcExAABby/jxq5sNgve+Wpj3twzQ==", 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.098 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.1", 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDGCsBmAq0lFxAAt1Fr40V7KeG2MoyBvW8ebg==", 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.2", 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDJCsBmbC3GGhAAP1RjM3jiyr6AADdPimUWNw==", 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.3", 2024-08-17T02:29:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDMCsBmoGUiHxAAKStyhVYSdY2y+8eIM4LcHw==", 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.4", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDSCsBmrS9mGhAAFRqsITV65onB0ZwMBOjT8Q==", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.5", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDVCsBmgv1XHxAAQYaWu4PBiu+VQ9+yBMoBAQ==", 2024-08-17T02:29:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.6", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDYCsBmbG4sIxAAqmrreGB5o5s2IuA6NGCofA==", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "osd.7", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDbCsBmZAsAKBAAUm1P7Km50dDsmSiDCG1xMQ==", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow profile osd", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile osd", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.0", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmQ/P/KxAA6/YlYKBE0kEf982XrEdQGA==", 2024-08-17T02:29:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.1", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBmK9gfOBAAknlE9UetXeSk9F1R6n1fmA==", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.2", 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBm+GEOMhAAa2CSQP93CvdjKFBtrjwiCQ==", 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.3", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDCCsBmJ/OXAhAAOhU5MOQzGt2biULdexICpw==", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow r", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow rw", 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow rwx" 2024-08-17T02:29:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.admin", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDACsBmioEBFRAAKcepvRkGdaQaHHhotMYPNA==", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "mgr": "allow *", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow *", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBmA/FcOhAAFuLkcaHtWmPb7TOCDzw8vg==", 2024-08-17T02:29:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBm8/xcOhAAfunvKFw7slopp5wmea74+Q==", 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBmLQVdOhAAQIOErhCyqFlFvtU7iw5MFw==", 2024-08-17T02:29:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBmEA1dOhAA3XcPv1m8CZ1PRdooFowv/w==", 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBmCxddOhAAw4wZM1pSHsYAUkfjTyO8fQ==", 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDiCsBmSR9dOhAAkCQnX5QrQ670qzgIrHIdBg==", 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.x", 2024-08-17T02:29:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDBCsBm6veJARAApiHTGxPnuChTx4K7Ih4m8Q==", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "entity": "mgr.y", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "key": "AQDACsBmJuNYNhAAjtbVni54w1UnqJPYevyZIA==", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "caps": { 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "mds": "allow *", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "mon": "allow profile mgr", 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "osd": "allow *" 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-08-17T02:29:52.113 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 msgr2=0x7fe828067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 0x7fe828067600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe834007fd0 tx=0x7fe834009040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 msgr2=0x7fe8480c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe838009360 tx=0x7fe838032000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 shutdown_connections 2024-08-17T02:29:52.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe828065150 0x7fe828067600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe848159350 0x7fe8480b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe848158f80 0x7fe8480b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 --2- 172.21.15.110:0/1418820676 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8480cf280 0x7fe8480c9330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 >> 172.21.15.110:0/1418820676 conn(0x7fe8480cfd90 msgr2=0x7fe8480d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 shutdown_connections 2024-08-17T02:29:52.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.095+0000 7fe84dc00640 1 -- 172.21.15.110:0/1418820676 wait complete. 2024-08-17T02:29:52.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:29:52.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.262+0000 7fd5a6000640 1 Processor -- start 2024-08-17T02:29:52.263 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.262+0000 7fd5a6000640 1 -- start start 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.263+0000 7fd5a6000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5a0155a20 0x7fd5a00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.263+0000 7fd5a6000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.263+0000 7fd5a6000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a0156670 con 0x7fd5a0155df0 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.263+0000 7fd5a6000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00b0350 con 0x7fd5a0155a20 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.263+0000 7fd5a6000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a006e5e0 con 0x7fd5a006df00 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59ea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd5a0155df0 0x7fd5a006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43114/0 (socket says 172.21.15.110:43114) 2024-08-17T02:29:52.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59ea00640 1 -- 172.21.15.110:0/98806805 learned_addr learned my addr 172.21.15.110:0/98806805 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59f400640 1 --2- 172.21.15.110:0/98806805 >> v2:172.21.15.177:3300/0 conn(0x7fd5a0155a20 0x7fd5a00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59fe00640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59e000640 1 -- 172.21.15.110:0/98806805 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989832436 0 0) 0x7fd5a0156670 con 0x7fd5a0155df0 2024-08-17T02:29:52.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59e000640 1 -- 172.21.15.110:0/98806805 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5840034e0 con 0x7fd5a0155df0 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59f400640 1 -- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 msgr2=0x7fd5a00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59f400640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.264+0000 7fd59f400640 1 -- 172.21.15.110:0/98806805 >> v1:172.21.15.110:6789/0 conn(0x7fd5a0155df0 legacy=0x7fd5a006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.266 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.265+0000 7fd59f400640 1 -- 172.21.15.110:0/98806805 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a006e8c0 con 0x7fd5a0155a20 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd59f400640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00adf10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd590009850 tx=0x7fd5900090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eedde81e99f9b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd59e000640 1 -- 172.21.15.110:0/98806805 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59002ad90 con 0x7fd5a0155a20 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd59e000640 1 -- 172.21.15.110:0/98806805 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590032440 con 0x7fd5a0155a20 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd59e000640 1 -- 172.21.15.110:0/98806805 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590032820 con 0x7fd5a0155a20 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 -- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 msgr2=0x7fd5a00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00adf10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd590009850 tx=0x7fd5900090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 -- 172.21.15.110:0/98806805 shutdown_connections 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 --2- 172.21.15.110:0/98806805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00adf10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.266+0000 7fd5a6000640 1 -- 172.21.15.110:0/98806805 >> 172.21.15.110:0/98806805 conn(0x7fd5a00cb9b0 msgr2=0x7fd5a00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.267+0000 7fd5a6000640 1 -- 172.21.15.110:0/98806805 shutdown_connections 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.267+0000 7fd5a6000640 1 -- 172.21.15.110:0/98806805 wait complete. 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.268+0000 7fd5a6000640 1 Processor -- start 2024-08-17T02:29:52.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.268+0000 7fd5a6000640 1 -- start start 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0169140 con 0x7fd5a0155df0 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00ad380 con 0x7fd5a0155a20 2024-08-17T02:29:52.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd5a6000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00ac930 con 0x7fd5a006df00 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd59fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60408/0 (socket says 172.21.15.110:60408) 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd59fe00640 1 -- 172.21.15.110:0/319142517 learned_addr learned my addr 172.21.15.110:0/319142517 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd59ea00640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.269+0000 7fd59f400640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 -- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 msgr2=0x7fd5a00ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 -- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 msgr2=0x7fd5a00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 -- 172.21.15.110:0/319142517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009390 con 0x7fd5a0155df0 2024-08-17T02:29:52.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd59fe00640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e90 tx=0x7fd59800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800cd40 con 0x7fd5a0155df0 2024-08-17T02:29:52.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800f040 con 0x7fd5a0155df0 2024-08-17T02:29:52.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5980146d0 con 0x7fd5a0155df0 2024-08-17T02:29:52.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.270+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a00c26c0 con 0x7fd5a0155df0 2024-08-17T02:29:52.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.271+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a00c2c80 con 0x7fd5a0155df0 2024-08-17T02:29:52.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.272+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0169290 con 0x7fd5a0155df0 2024-08-17T02:29:52.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.272+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd598014a80 con 0x7fd5a0155df0 2024-08-17T02:29:52.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.273+0000 7fd596a00640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 0x7fd580067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.273+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd598082b90 con 0x7fd5a0155df0 2024-08-17T02:29:52.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.273+0000 7fd59f400640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 0x7fd580067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.274+0000 7fd59f400640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 0x7fd580067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd590034000 tx=0x7fd590032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.277+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd5a0169290 con 0x7fd5a0155df0 2024-08-17T02:29:52.515 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.515+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd5a0169290 con 0x7fd5a0155df0 2024-08-17T02:29:52.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.519+0000 7fd596a00640 1 -- 172.21.15.110:0/319142517 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd5a0169290 con 0x7fd5a0155df0 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 msgr2=0x7fd580067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 0x7fd580067600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd590034000 tx=0x7fd590032000 comp rx=0 tx=0).stop 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 msgr2=0x7fd5a0154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e90 tx=0x7fd59800b040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 shutdown_connections 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd580065150 0x7fd580067600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5a0155df0 0x7fd5a0154360 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0155a20 0x7fd5a00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 --2- 172.21.15.110:0/319142517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5a006df00 0x7fd5a00ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 >> 172.21.15.110:0/319142517 conn(0x7fd5a00cb9b0 msgr2=0x7fd5a01504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 shutdown_connections 2024-08-17T02:29:52.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.521+0000 7fd5a6000640 1 -- 172.21.15.110:0/319142517 wait complete. 2024-08-17T02:29:52.536 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:29:52.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.686+0000 7f1855000640 1 Processor -- start 2024-08-17T02:29:52.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.687+0000 7f1855000640 1 -- start start 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f1855000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 0x7f18500ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f1855000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f185015c7c0 0x7f185015cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f1855000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18500ab950 con 0x7f18500a98e0 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f1855000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18500abc30 con 0x7f185015c7c0 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f1855000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18500abf10 con 0x7f18500cc010 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f184fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f185015c7c0 0x7f185015cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f184fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f185015c7c0 0x7f185015cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60414/0 (socket says 172.21.15.110:60414) 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f184fe00640 1 -- 172.21.15.110:0/799023062 learned_addr learned my addr 172.21.15.110:0/799023062 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.688+0000 7f184f400640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 0x7f18500ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.689+0000 7f184fe00640 1 -- 172.21.15.110:0/799023062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 msgr2=0x7f18500ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.689+0000 7f184fe00640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 0x7f18500ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.689+0000 7f184fe00640 1 -- 172.21.15.110:0/799023062 >> v1:172.21.15.177:6789/0 conn(0x7f18500a98e0 legacy=0x7f18500afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.689+0000 7f184fe00640 1 -- 172.21.15.110:0/799023062 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18500af970 con 0x7f185015c7c0 2024-08-17T02:29:52.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.689+0000 7f184f400640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 0x7f18500ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:52.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f184fe00640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185015c7c0 0x7f185015cc00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1848009f20 tx=0x7f1848009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a16ce34364afdd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f184e000640 1 -- 172.21.15.110:0/799023062 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848031400 con 0x7f185015c7c0 2024-08-17T02:29:52.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f184e000640 1 -- 172.21.15.110:0/799023062 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184802d050 con 0x7f185015c7c0 2024-08-17T02:29:52.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f184e000640 1 -- 172.21.15.110:0/799023062 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18480317d0 con 0x7f185015c7c0 2024-08-17T02:29:52.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 -- 172.21.15.110:0/799023062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185015c7c0 msgr2=0x7f185015cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185015c7c0 0x7f185015cc00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1848009f20 tx=0x7f1848009840 comp rx=0 tx=0).stop 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 -- 172.21.15.110:0/799023062 shutdown_connections 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185015c7c0 0x7f185015cc00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 --2- 172.21.15.110:0/799023062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18500cc010 0x7f18500ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 -- 172.21.15.110:0/799023062 >> 172.21.15.110:0/799023062 conn(0x7f1850067de0 msgr2=0x7f18500681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.690+0000 7f1855000640 1 -- 172.21.15.110:0/799023062 shutdown_connections 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.691+0000 7f1855000640 1 -- 172.21.15.110:0/799023062 wait complete. 2024-08-17T02:29:52.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.692+0000 7f1855000640 1 Processor -- start 2024-08-17T02:29:52.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.692+0000 7f1855000640 1 -- start start 2024-08-17T02:29:52.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18500cc010 0x7f18500ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 0x7f18500adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185015edd0 con 0x7f18500a98e0 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185015b5c0 con 0x7f18500cc010 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f1855000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185016c750 con 0x7f185015c7c0 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60418/0 (socket says 172.21.15.110:60418) 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 -- 172.21.15.110:0/3664715686 learned_addr learned my addr 172.21.15.110:0/3664715686 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184ea00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18500cc010 0x7f18500ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184fe00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 0x7f18500adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 -- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 msgr2=0x7f18500adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 0x7f18500adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 -- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18500cc010 msgr2=0x7f18500ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18500cc010 0x7f18500ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184f400640 1 -- 172.21.15.110:0/3664715686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848009ae0 con 0x7f18500a98e0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.693+0000 7f184fe00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 0x7f18500adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f184f400640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f184000d890 tx=0x7f1840008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000de80 con 0x7f18500a98e0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184000b960 con 0x7f18500a98e0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000bd20 con 0x7f18500a98e0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18501518b0 con 0x7f18500a98e0 2024-08-17T02:29:52.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.694+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185016ccc0 con 0x7f18500a98e0 2024-08-17T02:29:52.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.695+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1850071050 con 0x7f18500a98e0 2024-08-17T02:29:52.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.696+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1840014640 con 0x7f18500a98e0 2024-08-17T02:29:52.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.697+0000 7f1846a00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 0x7f1830067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:52.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.697+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1840082810 con 0x7f18500a98e0 2024-08-17T02:29:52.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.697+0000 7f184ea00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 0x7f1830067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:52.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.697+0000 7f184ea00640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 0x7f1830067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f185016c6b0 tx=0x7f183c007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:52.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.701+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1840050b80 con 0x7f18500a98e0 2024-08-17T02:29:52.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.936+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f18500aa890 con 0x7f18500a98e0 2024-08-17T02:29:52.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.940+0000 7f1846a00640 1 -- 172.21.15.110:0/3664715686 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f18400541a0 con 0x7f18500a98e0 2024-08-17T02:29:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 msgr2=0x7f1830067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 0x7f1830067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f185016c6b0 tx=0x7f183c007e30 comp rx=0 tx=0).stop 2024-08-17T02:29:52.943 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 msgr2=0x7f185014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f184000d890 tx=0x7f1840008040 comp rx=0 tx=0).stop 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 shutdown_connections 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1830065150 0x7f1830067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185015c7c0 0x7f18500adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18500cc010 0x7f18500ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 --2- 172.21.15.110:0/3664715686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18500a98e0 0x7f185014d890 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 >> 172.21.15.110:0/3664715686 conn(0x7f1850067de0 msgr2=0x7f18500b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 shutdown_connections 2024-08-17T02:29:52.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:52.942+0000 7f1855000640 1 -- 172.21.15.110:0/3664715686 wait complete. 2024-08-17T02:29:52.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:29:53.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.107+0000 7f8d84200640 1 Processor -- start 2024-08-17T02:29:53.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.107+0000 7f8d84200640 1 -- start start 2024-08-17T02:29:53.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d7c15a260 0x7f8d7c0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 0x7f8d7c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 0x7f8d7c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0abea0 con 0x7f8d7c15a260 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0adb60 con 0x7f8d7c0aba20 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d84200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0975a0 con 0x7f8d7c096a70 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d81800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d7c15a260 0x7f8d7c0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d81800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8d7c15a260 0x7f8d7c0b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60428/0 (socket says 172.21.15.110:60428) 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.108+0000 7f8d81800640 1 -- 172.21.15.110:0/3627270413 learned_addr learned my addr 172.21.15.110:0/3627270413 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d80e00640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 0x7f8d7c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d81800640 1 -- 172.21.15.110:0/3627270413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 msgr2=0x7f8d7c0ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d82200640 1 --2- 172.21.15.110:0/3627270413 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 0x7f8d7c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d81800640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 0x7f8d7c0ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d81800640 1 -- 172.21.15.110:0/3627270413 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 msgr2=0x7f8d7c0b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d81800640 1 --2- 172.21.15.110:0/3627270413 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 0x7f8d7c0b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d81800640 1 -- 172.21.15.110:0/3627270413 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c15a630 con 0x7f8d7c15a260 2024-08-17T02:29:53.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d82200640 1 --2- 172.21.15.110:0/3627270413 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 0x7f8d7c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:53.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.109+0000 7f8d80e00640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 0x7f8d7c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:53.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.110+0000 7f8d81800640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15a260 0x7f8d7c0b2880 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0aaf40 tx=0x7f8d700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc19b61927a0d012 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.110+0000 7f8d7be00640 1 -- 172.21.15.110:0/3627270413 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7002ad40 con 0x7f8d7c15a260 2024-08-17T02:29:53.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.110+0000 7f8d7be00640 1 -- 172.21.15.110:0/3627270413 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70032440 con 0x7f8d7c15a260 2024-08-17T02:29:53.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.110+0000 7f8d7be00640 1 -- 172.21.15.110:0/3627270413 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7002aea0 con 0x7f8d7c15a260 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 -- 172.21.15.110:0/3627270413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15a260 msgr2=0x7f8d7c0b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15a260 0x7f8d7c0b2880 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0aaf40 tx=0x7f8d700091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 -- 172.21.15.110:0/3627270413 shutdown_connections 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 --2- 172.21.15.110:0/3627270413 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c0aba20 0x7f8d7c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c096a70 0x7f8d7c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 --2- 172.21.15.110:0/3627270413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c15a260 0x7f8d7c0b2880 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 -- 172.21.15.110:0/3627270413 >> 172.21.15.110:0/3627270413 conn(0x7f8d7c0b3040 msgr2=0x7f8d7c0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 -- 172.21.15.110:0/3627270413 shutdown_connections 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.111+0000 7f8d84200640 1 -- 172.21.15.110:0/3627270413 wait complete. 2024-08-17T02:29:53.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.112+0000 7f8d84200640 1 Processor -- start 2024-08-17T02:29:53.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.112+0000 7f8d84200640 1 -- start start 2024-08-17T02:29:53.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0aba20 0x7f8d7c0696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c15a260 0x7f8d7c0b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c09b320 con 0x7f8d7c096a70 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c09a710 con 0x7f8d7c0aba20 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d84200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c09a9f0 con 0x7f8d7c15a260 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.113+0000 7f8d81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60444/0 (socket says 172.21.15.110:60444) 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 -- 172.21.15.110:0/77550738 learned_addr learned my addr 172.21.15.110:0/77550738 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 -- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c15a260 msgr2=0x7f8d7c0b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c15a260 0x7f8d7c0b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 -- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0aba20 msgr2=0x7f8d7c0696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0aba20 0x7f8d7c0696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 -- 172.21.15.110:0/77550738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009450 con 0x7f8d7c096a70 2024-08-17T02:29:53.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d81800640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d70035040 tx=0x7f8d70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70031a60 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70031c00 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c09acd0 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.114+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7003d420 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.115+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c155490 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.115+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c064db0 con 0x7f8d7c096a70 2024-08-17T02:29:53.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.116+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d70039040 con 0x7f8d7c096a70 2024-08-17T02:29:53.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.117+0000 7f8d78c00640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 0x7f8d5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.118+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8d700a22b0 con 0x7f8d7c096a70 2024-08-17T02:29:53.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.118+0000 7f8d80e00640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 0x7f8d5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.118+0000 7f8d80e00640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 0x7f8d5c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006fd0 tx=0x7f8d68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.122+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d70070620 con 0x7f8d7c096a70 2024-08-17T02:29:53.358 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.358+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f8d7c0b04d0 con 0x7f8d7c096a70 2024-08-17T02:29:53.362 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.362+0000 7f8d78c00640 1 -- 172.21.15.110:0/77550738 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8d70073c40 con 0x7f8d7c096a70 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 msgr2=0x7f8d5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 0x7f8d5c067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006fd0 tx=0x7f8d68008040 comp rx=0 tx=0).stop 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 msgr2=0x7f8d7c154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8d70035040 tx=0x7f8d70032000 comp rx=0 tx=0).stop 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 shutdown_connections 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d5c065150 0x7f8d5c067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c15a260 0x7f8d7c0b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0aba20 0x7f8d7c0696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.365 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 --2- 172.21.15.110:0/77550738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d7c096a70 0x7f8d7c154f50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 >> 172.21.15.110:0/77550738 conn(0x7f8d7c0b3040 msgr2=0x7f8d7c155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.364+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 shutdown_connections 2024-08-17T02:29:53.366 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.365+0000 7f8d84200640 1 -- 172.21.15.110:0/77550738 wait complete. 2024-08-17T02:29:53.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:29:53.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.527+0000 7ff6cfa00640 1 Processor -- start 2024-08-17T02:29:53.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.527+0000 7ff6cfa00640 1 -- start start 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.528+0000 7ff6cfa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6c80caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.528+0000 7ff6cfa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80caa80 con 0x7ff6c81401b0 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.528+0000 7ff6cfa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80c9e70 con 0x7ff6c8140580 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.528+0000 7ff6cfa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80cb450 con 0x7ff6c80b1440 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6cd000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff6c81401b0 0x7ff6c80b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:43120/0 (socket says 172.21.15.110:43120) 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6cd000640 1 -- 172.21.15.110:0/3991910233 learned_addr learned my addr 172.21.15.110:0/3991910233 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6bfe00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6c80caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.531 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222098331 0 0) 0x7ff6c80caa80 con 0x7ff6c81401b0 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac0034e0 con 0x7ff6c81401b0 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900711671 0 0) 0x7ff6c80c9e70 con 0x7ff6c8140580 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.529+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c80caa80 con 0x7ff6c8140580 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2178135514 0 0) 0x7ff6ac0034e0 con 0x7ff6c81401b0 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 msgr2=0x7ff6c80caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6c80caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 >> v1:172.21.15.177:6789/0 conn(0x7ff6c8140580 legacy=0x7ff6c80c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c80ca150 con 0x7ff6c81401b0 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7ff6b8001470 con 0x7ff6c81401b0 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 >> v1:172.21.15.110:6789/0 conn(0x7ff6c81401b0 legacy=0x7ff6c80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ac003b90 0x7ff6ac003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6ac004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.532 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6ac005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80cb450 con 0x7ff6ac004cc0 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00bab0 con 0x7ff6ac003b90 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00bc70 con 0x7ff6c80b1440 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6ac005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6bfe00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6ac004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cd000640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ac003b90 0x7ff6ac003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 -- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 msgr2=0x7ff6ac004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c80b1440 0x7ff6ac004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 -- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ac003b90 msgr2=0x7ff6ac003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ac003b90 0x7ff6ac003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cda00640 1 -- 172.21.15.110:0/3991910233 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac0034e0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.533 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.530+0000 7ff6cd000640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6ac003b90 0x7ff6ac003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:53.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.531+0000 7ff6cda00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6ac005130 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0002080 tx=0x7ff6c0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd8b5f585c2a053 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.531+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0031440 con 0x7ff6ac004cc0 2024-08-17T02:29:53.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c002d050 con 0x7ff6ac004cc0 2024-08-17T02:29:53.536 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6c7e00640 1 -- 172.21.15.110:0/3991910233 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00317f0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 -- 172.21.15.110:0/3991910233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 msgr2=0x7ff6ac005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/3991910233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6ac005130 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0002080 tx=0x7ff6c0007f90 comp rx=0 tx=0).stop 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cda00640 1 -- 172.21.15.110:0/3991910233 reap_dead start 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 -- 172.21.15.110:0/3991910233 shutdown_connections 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 -- 172.21.15.110:0/3991910233 >> 172.21.15.110:0/3991910233 conn(0x7ff6c80cb9b0 msgr2=0x7ff6c80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 -- 172.21.15.110:0/3991910233 shutdown_connections 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.532+0000 7ff6cfa00640 1 -- 172.21.15.110:0/3991910233 wait complete. 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 Processor -- start 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 -- start start 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c8168e60 0x7ff6c81692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c81697f0 0x7ff6c815e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815d5e0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.537 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815c9c0 con 0x7ff6c8168e60 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.534+0000 7ff6cfa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815d860 con 0x7ff6c81697f0 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:60464/0 (socket says 172.21.15.110:60464) 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 -- 172.21.15.110:0/222067189 learned_addr learned my addr 172.21.15.110:0/222067189 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6bfe00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c8168e60 0x7ff6c81692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cda00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c81697f0 0x7ff6c815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 -- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c81697f0 msgr2=0x7ff6c815e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c81697f0 0x7ff6c815e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 -- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c8168e60 msgr2=0x7ff6c81692b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c8168e60 0x7ff6c81692b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.535+0000 7ff6cd000640 1 -- 172.21.15.110:0/222067189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c815db40 con 0x7ff6ac004cc0 2024-08-17T02:29:53.538 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6cd000640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000ff0 tx=0x7ff6b8001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800c960 con 0x7ff6ac004cc0 2024-08-17T02:29:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b800cac0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800ce80 con 0x7ff6ac004cc0 2024-08-17T02:29:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c815de20 con 0x7ff6ac004cc0 2024-08-17T02:29:53.539 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.536+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c813f6e0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.537+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c813f960 con 0x7ff6ac004cc0 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.538+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff6b8013630 con 0x7ff6ac004cc0 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.538+0000 7ff6c4c00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 0x7ff6a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.538+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff6b8082170 con 0x7ff6ac004cc0 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.539+0000 7ff6bfe00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 0x7ff6a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.540 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.539+0000 7ff6bfe00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 0x7ff6a4067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80acfc0 tx=0x7ff6b00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.543 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.542+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff6b80504e0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.781+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff6c8064db0 con 0x7ff6ac004cc0 2024-08-17T02:29:53.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.785+0000 7ff6c4c00640 1 -- 172.21.15.110:0/222067189 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff6b8053b00 con 0x7ff6ac004cc0 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 msgr2=0x7ff6a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 0x7ff6a4067600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6c80acfc0 tx=0x7ff6b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 msgr2=0x7ff6c813f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8000ff0 tx=0x7ff6b8001060 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 shutdown_connections 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff6a4065150 0x7ff6a4067600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6c81697f0 0x7ff6c815e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6c8168e60 0x7ff6c81692b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 --2- 172.21.15.110:0/222067189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac004cc0 0x7ff6c813f1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 >> 172.21.15.110:0/222067189 conn(0x7ff6c80cb9b0 msgr2=0x7ff6c80c0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 shutdown_connections 2024-08-17T02:29:53.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.787+0000 7ff6cfa00640 1 -- 172.21.15.110:0/222067189 wait complete. 2024-08-17T02:29:53.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:29:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.951+0000 7f9886400640 1 Processor -- start 2024-08-17T02:29:53.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.951+0000 7f9886400640 1 -- start start 2024-08-17T02:29:53.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.952+0000 7f9886400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f988006df00 0x7f98800adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f9886400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9880156670 con 0x7f9880155df0 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f9886400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988006e5e0 con 0x7f9880155a20 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f9886400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98800b0350 con 0x7f988006df00 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f988006df00 0x7f98800adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f988006df00 0x7f98800adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45742/0 (socket says 172.21.15.110:45742) 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9880155df0 0x7f9880156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33248/0 (socket says 172.21.15.110:33248) 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 -- 172.21.15.110:0/859514883 learned_addr learned my addr 172.21.15.110:0/859514883 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 -- 172.21.15.110:0/859514883 >> v1:172.21.15.177:6789/0 conn(0x7f9880155a20 legacy=0x7f988006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 -- 172.21.15.110:0/859514883 >> v1:172.21.15.110:6789/0 conn(0x7f9880155df0 legacy=0x7f9880156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987e000640 1 -- 172.21.15.110:0/859514883 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278504509 0 0) 0x7f9880156670 con 0x7f9880155df0 2024-08-17T02:29:53.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.953+0000 7f987ea00640 1 -- 172.21.15.110:0/859514883 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988006e8c0 con 0x7f988006df00 2024-08-17T02:29:53.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.954+0000 7f987ea00640 1 --2- 172.21.15.110:0/859514883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988006df00 0x7f98800adf10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f986800bbc0 tx=0x7f986800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6dc3e72cfd8b0a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f987e000640 1 -- 172.21.15.110:0/859514883 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868031630 con 0x7f988006df00 2024-08-17T02:29:53.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f987e000640 1 -- 172.21.15.110:0/859514883 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868031790 con 0x7f988006df00 2024-08-17T02:29:53.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f987e000640 1 -- 172.21.15.110:0/859514883 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868031b30 con 0x7f988006df00 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 -- 172.21.15.110:0/859514883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988006df00 msgr2=0x7f98800adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 --2- 172.21.15.110:0/859514883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988006df00 0x7f98800adf10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f986800bbc0 tx=0x7f986800b460 comp rx=0 tx=0).stop 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 -- 172.21.15.110:0/859514883 shutdown_connections 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 --2- 172.21.15.110:0/859514883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988006df00 0x7f98800adf10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 -- 172.21.15.110:0/859514883 >> 172.21.15.110:0/859514883 conn(0x7f98800cb9b0 msgr2=0x7f98800cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:53.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 -- 172.21.15.110:0/859514883 shutdown_connections 2024-08-17T02:29:53.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.955+0000 7f9886400640 1 -- 172.21.15.110:0/859514883 wait complete. 2024-08-17T02:29:53.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.957+0000 7f9886400640 1 Processor -- start 2024-08-17T02:29:53.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.957+0000 7f9886400640 1 -- start start 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.957+0000 7f9886400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988006df00 0x7f98800a8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f9886400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f9886400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9880155df0 0x7f98800a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f9886400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800a7f30 con 0x7f9880155a20 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f9886400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98800a9140 con 0x7f988006df00 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f9886400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98800a73f0 con 0x7f9880155df0 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45746/0 (socket says 172.21.15.110:45746) 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 -- 172.21.15.110:0/3413276324 learned_addr learned my addr 172.21.15.110:0/3413276324 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:53.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987fe00640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9880155df0 0x7f98800a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987f400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988006df00 0x7f98800a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 -- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9880155df0 msgr2=0x7f98800a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9880155df0 0x7f98800a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 -- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988006df00 msgr2=0x7f98800a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988006df00 0x7f98800a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.958+0000 7f987ea00640 1 -- 172.21.15.110:0/3413276324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986800b700 con 0x7f9880155a20 2024-08-17T02:29:53.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f987ea00640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f986800bbc0 tx=0x7f986803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986803ae90 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9868040040 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868044640 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98800a7690 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.959+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98800a7c50 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.960+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98800a92d0 con 0x7f9880155a20 2024-08-17T02:29:53.961 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.961+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9868044a70 con 0x7f9880155a20 2024-08-17T02:29:53.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.961+0000 7f9876a00640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 0x7f985c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:53.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.962+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f98680a5ec0 con 0x7f9880155a20 2024-08-17T02:29:53.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.962+0000 7f987f400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 0x7f985c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:53.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.962+0000 7f987f400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 0x7f985c067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9880150350 tx=0x7f9870009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:53.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:53.966+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98680742e0 con 0x7f9880155a20 2024-08-17T02:29:54.200 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.200+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9880064db0 con 0x7f9880155a20 2024-08-17T02:29:54.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.204+0000 7f9876a00640 1 -- 172.21.15.110:0/3413276324 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9868077900 con 0x7f9880155a20 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 msgr2=0x7f985c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 0x7f985c067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9880150350 tx=0x7f9870009040 comp rx=0 tx=0).stop 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 msgr2=0x7f988013df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f986800bbc0 tx=0x7f986803a000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 shutdown_connections 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f985c065150 0x7f985c067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9880155df0 0x7f98800a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9880155a20 0x7f988013df60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 --2- 172.21.15.110:0/3413276324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f988006df00 0x7f98800a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.206+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 >> 172.21.15.110:0/3413276324 conn(0x7f98800cb9b0 msgr2=0x7f9880154120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.207+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 shutdown_connections 2024-08-17T02:29:54.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.207+0000 7f9886400640 1 -- 172.21.15.110:0/3413276324 wait complete. 2024-08-17T02:29:54.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:29:54.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.371+0000 7f20fbe00640 1 Processor -- start 2024-08-17T02:29:54.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.371+0000 7f20fbe00640 1 -- start start 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20fbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20fc159ca0 0x7f20fc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20fbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 0x7f20fc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20fbe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20fc0ccf30 con 0x7f20fc0ccad0 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20fbe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0cd6e0 con 0x7f20fc159ca0 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20fbe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20fc0cadc0 con 0x7f20fc0ca8a0 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20faa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20fc159ca0 0x7f20fc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20faa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20fc159ca0 0x7f20fc0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45760/0 (socket says 172.21.15.110:45760) 2024-08-17T02:29:54.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.372+0000 7f20faa00640 1 -- 172.21.15.110:0/2412569502 learned_addr learned my addr 172.21.15.110:0/2412569502 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:54.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20fa000640 1 --2- 172.21.15.110:0/2412569502 >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 0x7f20fc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20faa00640 1 -- 172.21.15.110:0/2412569502 >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 msgr2=0x7f20fc0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20faa00640 1 --2- 172.21.15.110:0/2412569502 >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 0x7f20fc0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20faa00640 1 -- 172.21.15.110:0/2412569502 >> v1:172.21.15.177:6789/0 conn(0x7f20fc0ccad0 legacy=0x7f20fc0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20faa00640 1 -- 172.21.15.110:0/2412569502 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20fc0cb060 con 0x7f20fc159ca0 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.373+0000 7f20fa000640 1 --2- 172.21.15.110:0/2412569502 >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 0x7f20fc0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.374+0000 7f20faa00640 1 --2- 172.21.15.110:0/2412569502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc0ca360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20fc08a060 tx=0x7f20ec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f3d43a7216051a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.374+0000 7f20f9600640 1 -- 172.21.15.110:0/2412569502 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec02ae80 con 0x7f20fc159ca0 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.374+0000 7f20f9600640 1 -- 172.21.15.110:0/2412569502 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec032440 con 0x7f20fc159ca0 2024-08-17T02:29:54.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.374+0000 7f20f9600640 1 -- 172.21.15.110:0/2412569502 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec032800 con 0x7f20fc159ca0 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 -- 172.21.15.110:0/2412569502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 msgr2=0x7f20fc0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 --2- 172.21.15.110:0/2412569502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc0ca360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20fc08a060 tx=0x7f20ec0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 -- 172.21.15.110:0/2412569502 shutdown_connections 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 --2- 172.21.15.110:0/2412569502 >> v2:172.21.15.177:3300/0 conn(0x7f20fc0ca8a0 0x7f20fc0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 --2- 172.21.15.110:0/2412569502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc0ca360 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 -- 172.21.15.110:0/2412569502 >> 172.21.15.110:0/2412569502 conn(0x7f20fc098e00 msgr2=0x7f20fc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 -- 172.21.15.110:0/2412569502 shutdown_connections 2024-08-17T02:29:54.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.375+0000 7f20fbe00640 1 -- 172.21.15.110:0/2412569502 wait complete. 2024-08-17T02:29:54.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.376+0000 7f20fbe00640 1 Processor -- start 2024-08-17T02:29:54.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.376+0000 7f20fbe00640 1 -- start start 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20fc0ca8a0 0x7f20fc168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20fc0ccad0 0x7f20fc155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c8aa0 con 0x7f20fc159ca0 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c7e90 con 0x7f20fc0ca8a0 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.377+0000 7f20fbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20fc0c8170 con 0x7f20fc0ccad0 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45770/0 (socket says 172.21.15.110:45770) 2024-08-17T02:29:54.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 -- 172.21.15.110:0/784712472 learned_addr learned my addr 172.21.15.110:0/784712472 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fa000640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20fc0ccad0 0x7f20fc155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20faa00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20fc0ca8a0 0x7f20fc168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 -- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20fc0ccad0 msgr2=0x7f20fc155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20fc0ccad0 0x7f20fc155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 -- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20fc0ca8a0 msgr2=0x7f20fc168a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20fc0ca8a0 0x7f20fc168a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 -- 172.21.15.110:0/784712472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec009450 con 0x7f20fc159ca0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.378+0000 7f20fb400640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c840 tx=0x7f20f4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.379+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400ce30 con 0x7f20fc159ca0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.379+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4006b10 con 0x7f20fc159ca0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.379+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400a850 con 0x7f20fc159ca0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.379+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20fc0c8450 con 0x7f20fc159ca0 2024-08-17T02:29:54.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.379+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20fc168f60 con 0x7f20fc159ca0 2024-08-17T02:29:54.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.380+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20fc0c8c50 con 0x7f20fc159ca0 2024-08-17T02:29:54.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.381+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f20f400ac80 con 0x7f20fc159ca0 2024-08-17T02:29:54.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.381+0000 7f20f2000640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 0x7f20dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.381+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f20f4081ef0 con 0x7f20fc159ca0 2024-08-17T02:29:54.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.382+0000 7f20faa00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 0x7f20dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.382+0000 7f20faa00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 0x7f20dc067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f20ec034000 tx=0x7f20ec032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.385+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f20fc0c8c50 con 0x7f20fc159ca0 2024-08-17T02:29:54.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.623+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f20fc071050 con 0x7f20fc159ca0 2024-08-17T02:29:54.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.627+0000 7f20f2000640 1 -- 172.21.15.110:0/784712472 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f20f4050310 con 0x7f20fc159ca0 2024-08-17T02:29:54.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.629+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 msgr2=0x7f20dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.629+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 0x7f20dc067600 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f20ec034000 tx=0x7f20ec032000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.629+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 msgr2=0x7f20fc15ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.629+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c840 tx=0x7f20f4001690 comp rx=0 tx=0).stop 2024-08-17T02:29:54.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 shutdown_connections 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f20dc065150 0x7f20dc067600 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20fc159ca0 0x7f20fc15ca80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20fc0ccad0 0x7f20fc155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 --2- 172.21.15.110:0/784712472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20fc0ca8a0 0x7f20fc168a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 >> 172.21.15.110:0/784712472 conn(0x7f20fc098e00 msgr2=0x7f20fc159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 shutdown_connections 2024-08-17T02:29:54.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.630+0000 7f20fbe00640 1 -- 172.21.15.110:0/784712472 wait complete. 2024-08-17T02:29:54.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:54.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.794+0000 7f617e400640 1 Processor -- start 2024-08-17T02:29:54.794 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.794+0000 7f617e400640 1 -- start start 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617e400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61780ac780 0x7f61780af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f61780af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617e400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6178067d60 con 0x7f6178158ad0 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617e400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6178068600 con 0x7f61780ac780 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61780b01d0 con 0x7f6178158ea0 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f616fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61780ac780 0x7f61780af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f616fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61780ac780 0x7f61780af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45778/0 (socket says 172.21.15.110:45778) 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f616fe00640 1 -- 172.21.15.110:0/2858125656 learned_addr learned my addr 172.21.15.110:0/2858125656 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.795+0000 7f617da00640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f61780af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.796+0000 7f616fe00640 1 -- 172.21.15.110:0/2858125656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 msgr2=0x7f61780af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:54.796 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.796+0000 7f616fe00640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f61780af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.796+0000 7f616fe00640 1 -- 172.21.15.110:0/2858125656 >> v1:172.21.15.177:6789/0 conn(0x7f6178158ad0 legacy=0x7f61780ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.797 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.796+0000 7f616fe00640 1 -- 172.21.15.110:0/2858125656 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6178067fb0 con 0x7f61780ac780 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f616fe00640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780af410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6160009910 tx=0x7f61600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0188cb0b73c7dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f6177e00640 1 -- 172.21.15.110:0/2858125656 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616002ad20 con 0x7f61780ac780 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f6177e00640 1 -- 172.21.15.110:0/2858125656 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616002ae80 con 0x7f61780ac780 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f6177e00640 1 -- 172.21.15.110:0/2858125656 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160032670 con 0x7f61780ac780 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 -- 172.21.15.110:0/2858125656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 msgr2=0x7f61780af410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780af410 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6160009910 tx=0x7f61600091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 -- 172.21.15.110:0/2858125656 shutdown_connections 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f61780af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 --2- 172.21.15.110:0/2858125656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780af410 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.798 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.797+0000 7f617e400640 1 -- 172.21.15.110:0/2858125656 >> 172.21.15.110:0/2858125656 conn(0x7f6178096a70 msgr2=0x7f6178096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.798+0000 7f617e400640 1 -- 172.21.15.110:0/2858125656 shutdown_connections 2024-08-17T02:29:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.798+0000 7f617e400640 1 -- 172.21.15.110:0/2858125656 wait complete. 2024-08-17T02:29:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.799+0000 7f617e400640 1 Processor -- start 2024-08-17T02:29:54.799 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.799+0000 7f617e400640 1 -- start start 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6178158ad0 0x7f6178168ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f6178156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617814b670 con 0x7f61780ac780 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617814b950 con 0x7f6178158ad0 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617814bc30 con 0x7f6178158ea0 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617d000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45786/0 (socket says 172.21.15.110:45786) 2024-08-17T02:29:54.801 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617d000640 1 -- 172.21.15.110:0/1951965434 learned_addr learned my addr 172.21.15.110:0/1951965434 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f616fe00640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6178158ad0 0x7f6178168ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.800+0000 7f617da00640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f6178156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 -- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 msgr2=0x7f6178156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f6178156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 -- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6178158ad0 msgr2=0x7f6178168ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6178158ad0 0x7f6178168ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 -- 172.21.15.110:0/1951965434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009450 con 0x7f61780ac780 2024-08-17T02:29:54.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617d000640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f616800c560 tx=0x7f6168007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168011590 con 0x7f61780ac780 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6168011710 con 0x7f61780ac780 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168011ad0 con 0x7f61780ac780 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617814bf10 con 0x7f61780ac780 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.801+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61781690e0 con 0x7f61780ac780 2024-08-17T02:29:54.803 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.802+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617814c410 con 0x7f61780ac780 2024-08-17T02:29:54.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.803+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f616801b3b0 con 0x7f61780ac780 2024-08-17T02:29:54.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.804+0000 7f6174c00640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 0x7f6154067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:54.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.804+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6168081690 con 0x7f61780ac780 2024-08-17T02:29:54.804 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.804+0000 7f616fe00640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 0x7f6154067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:54.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.805+0000 7f616fe00640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 0x7f6154067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f6160032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:54.808 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.808+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f616804fab0 con 0x7f61780ac780 2024-08-17T02:29:54.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.981+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6178071050 con 0x7f61780ac780 2024-08-17T02:29:54.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.981+0000 7f6174c00640 1 -- 172.21.15.110:0/1951965434 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f6168017020 con 0x7f61780ac780 2024-08-17T02:29:54.982 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:54.982 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":29,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:51.683700+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:54.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 msgr2=0x7f6154067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 0x7f6154067600 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6160034000 tx=0x7f6160032000 comp rx=0 tx=0).stop 2024-08-17T02:29:54.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 msgr2=0x7f61780c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f616800c560 tx=0x7f6168007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 shutdown_connections 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6154065150 0x7f6154067600 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6178158ea0 0x7f6178156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6178158ad0 0x7f6178168ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 --2- 172.21.15.110:0/1951965434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61780ac780 0x7f61780c92b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 >> 172.21.15.110:0/1951965434 conn(0x7f6178096a70 msgr2=0x7f61780aa730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 shutdown_connections 2024-08-17T02:29:54.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:54.984+0000 7f617e400640 1 -- 172.21.15.110:0/1951965434 wait complete. 2024-08-17T02:29:55.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:29:55.001 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:29:55.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.151+0000 7fe03e400640 1 Processor -- start 2024-08-17T02:29:55.151 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.151+0000 7fe03e400640 1 -- start start 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe03e400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe03815c5b0 0x7fe0380ac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe03e400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0380ac9b0 0x7fe038068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe03e400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe038068690 con 0x7fe03815c1e0 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe03e400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0380acdf0 con 0x7fe0380ac9b0 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe03e400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0380abeb0 con 0x7fe03815c5b0 2024-08-17T02:29:55.153 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe037e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0380ac9b0 0x7fe038068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe037400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe03815c1e0 0x7fe0380ab7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33252/0 (socket says 172.21.15.110:33252) 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe037e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0380ac9b0 0x7fe038068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45800/0 (socket says 172.21.15.110:45800) 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.152+0000 7fe037400640 1 -- 172.21.15.110:0/2113855898 learned_addr learned my addr 172.21.15.110:0/2113855898 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe036a00640 1 --2- 172.21.15.110:0/2113855898 >> v2:172.21.15.177:3300/0 conn(0x7fe03815c5b0 0x7fe0380ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe037e00640 1 -- 172.21.15.110:0/2113855898 >> v2:172.21.15.177:3300/0 conn(0x7fe03815c5b0 msgr2=0x7fe0380ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe037e00640 1 --2- 172.21.15.110:0/2113855898 >> v2:172.21.15.177:3300/0 conn(0x7fe03815c5b0 0x7fe0380ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe037e00640 1 -- 172.21.15.110:0/2113855898 >> v1:172.21.15.110:6789/0 conn(0x7fe03815c1e0 legacy=0x7fe0380ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe037e00640 1 -- 172.21.15.110:0/2113855898 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380ac140 con 0x7fe0380ac9b0 2024-08-17T02:29:55.154 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.153+0000 7fe036000640 1 -- 172.21.15.110:0/2113855898 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402017471 0 0) 0x7fe038068690 con 0x7fe03815c1e0 2024-08-17T02:29:55.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.154+0000 7fe037e00640 1 --2- 172.21.15.110:0/2113855898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380ac9b0 0x7fe038068b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe03806e3b0 tx=0x7fe030009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6713446ca796fed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.154+0000 7fe036000640 1 -- 172.21.15.110:0/2113855898 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030007550 con 0x7fe0380ac9b0 2024-08-17T02:29:55.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.154+0000 7fe036000640 1 -- 172.21.15.110:0/2113855898 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03002d050 con 0x7fe0380ac9b0 2024-08-17T02:29:55.155 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.154+0000 7fe036000640 1 -- 172.21.15.110:0/2113855898 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0300078e0 con 0x7fe0380ac9b0 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 -- 172.21.15.110:0/2113855898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380ac9b0 msgr2=0x7fe038068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 --2- 172.21.15.110:0/2113855898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380ac9b0 0x7fe038068b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe03806e3b0 tx=0x7fe030009780 comp rx=0 tx=0).stop 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 -- 172.21.15.110:0/2113855898 shutdown_connections 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 --2- 172.21.15.110:0/2113855898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0380ac9b0 0x7fe038068b20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 --2- 172.21.15.110:0/2113855898 >> v2:172.21.15.177:3300/0 conn(0x7fe03815c5b0 0x7fe0380ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 -- 172.21.15.110:0/2113855898 >> 172.21.15.110:0/2113855898 conn(0x7fe038096a70 msgr2=0x7fe038096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 -- 172.21.15.110:0/2113855898 shutdown_connections 2024-08-17T02:29:55.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.155+0000 7fe03e400640 1 -- 172.21.15.110:0/2113855898 wait complete. 2024-08-17T02:29:55.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.156+0000 7fe03e400640 1 Processor -- start 2024-08-17T02:29:55.157 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.156+0000 7fe03e400640 1 -- start start 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380ac9b0 0x7fe038157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe03815c5b0 0x7fe0380b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380b2100 con 0x7fe03815c1e0 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380b2b00 con 0x7fe0380ac9b0 2024-08-17T02:29:55.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe03e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380b1e20 con 0x7fe03815c5b0 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe036a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe036a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45814/0 (socket says 172.21.15.110:45814) 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe036a00640 1 -- 172.21.15.110:0/796610454 learned_addr learned my addr 172.21.15.110:0/796610454 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.157+0000 7fe037400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380ac9b0 0x7fe038157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe037e00640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe03815c5b0 0x7fe0380b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 -- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe03815c5b0 msgr2=0x7fe0380b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe03815c5b0 0x7fe0380b2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 -- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380ac9b0 msgr2=0x7fe038157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380ac9b0 0x7fe038157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 -- 172.21.15.110:0/796610454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030009a20 con 0x7fe03815c1e0 2024-08-17T02:29:55.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe036a00640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e8d0 tx=0x7fe0240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400eec0 con 0x7fe03815c1e0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02400c8e0 con 0x7fe03815c1e0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400cc80 con 0x7fe03815c1e0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0380b24b0 con 0x7fe03815c1e0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.158+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0380b1a40 con 0x7fe03815c1e0 2024-08-17T02:29:55.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.159+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0380b2310 con 0x7fe03815c1e0 2024-08-17T02:29:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.160+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe024013470 con 0x7fe03815c1e0 2024-08-17T02:29:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.161+0000 7fe02ea00640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 0x7fe018067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.161+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe024081ff0 con 0x7fe03815c1e0 2024-08-17T02:29:55.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.161+0000 7fe037400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 0x7fe018067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.162+0000 7fe037400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 0x7fe018067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0280011e0 tx=0x7fe028007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.165 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.165+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe0380b2310 con 0x7fe03815c1e0 2024-08-17T02:29:55.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.336+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0380b2310 con 0x7fe03815c1e0 2024-08-17T02:29:55.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.337+0000 7fe02ea00640 1 -- 172.21.15.110:0/796610454 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0380b2310 con 0x7fe03815c1e0 2024-08-17T02:29:55.337 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.338+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 msgr2=0x7fe018067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.338+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 0x7fe018067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0280011e0 tx=0x7fe028007ca0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.338+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 msgr2=0x7fe038146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.338+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e8d0 tx=0x7fe0240090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 shutdown_connections 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe018065150 0x7fe018067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe03815c5b0 0x7fe0380b2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe03815c1e0 0x7fe038146440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 --2- 172.21.15.110:0/796610454 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0380ac9b0 0x7fe038157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 >> 172.21.15.110:0/796610454 conn(0x7fe038096a70 msgr2=0x7fe038159330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 shutdown_connections 2024-08-17T02:29:55.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.339+0000 7fe03e400640 1 -- 172.21.15.110:0/796610454 wait complete. 2024-08-17T02:29:55.354 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:29:55.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.502+0000 7f50cbe00640 1 Processor -- start 2024-08-17T02:29:55.503 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.503+0000 7f50cbe00640 1 -- start start 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50cbe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50cc06db70 0x7f50cc0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc158fb0 0x7f50cc0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50cbe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0aa0d0 con 0x7f50cc06d7a0 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50cbe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc159410 con 0x7f50cc06db70 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0cc4f0 con 0x7f50cc158fb0 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.504+0000 7f50c2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50cc06db70 0x7f50cc0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.505 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50cc06db70 0x7f50cc0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45822/0 (socket says 172.21.15.110:45822) 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 -- 172.21.15.110:0/3468283373 learned_addr learned my addr 172.21.15.110:0/3468283373 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 -- 172.21.15.110:0/3468283373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc158fb0 msgr2=0x7f50cc0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 --2- 172.21.15.110:0/3468283373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc158fb0 0x7f50cc0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 -- 172.21.15.110:0/3468283373 >> v1:172.21.15.177:6789/0 conn(0x7f50cc06d7a0 legacy=0x7f50cc1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.505+0000 7f50c2000640 1 -- 172.21.15.110:0/3468283373 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0a9a80 con 0x7f50cc06db70 2024-08-17T02:29:55.506 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.506+0000 7f50c2000640 1 --2- 172.21.15.110:0/3468283373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc0cbea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009910 tx=0x7f50b40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c2a6c159a2ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.506+0000 7f50ca000640 1 -- 172.21.15.110:0/3468283373 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b402ae40 con 0x7f50cc06db70 2024-08-17T02:29:55.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.506+0000 7f50ca000640 1 -- 172.21.15.110:0/3468283373 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4032440 con 0x7f50cc06db70 2024-08-17T02:29:55.507 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.506+0000 7f50ca000640 1 -- 172.21.15.110:0/3468283373 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4032820 con 0x7f50cc06db70 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 -- 172.21.15.110:0/3468283373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 msgr2=0x7f50cc0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 --2- 172.21.15.110:0/3468283373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc0cbea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f50b4009910 tx=0x7f50b40091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 -- 172.21.15.110:0/3468283373 shutdown_connections 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 --2- 172.21.15.110:0/3468283373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc158fb0 0x7f50cc0aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 --2- 172.21.15.110:0/3468283373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc0cbea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 -- 172.21.15.110:0/3468283373 >> 172.21.15.110:0/3468283373 conn(0x7f50cc067750 msgr2=0x7f50cc0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 -- 172.21.15.110:0/3468283373 shutdown_connections 2024-08-17T02:29:55.508 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.507+0000 7f50cbe00640 1 -- 172.21.15.110:0/3468283373 wait complete. 2024-08-17T02:29:55.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.508+0000 7f50cbe00640 1 Processor -- start 2024-08-17T02:29:55.509 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.508+0000 7f50cbe00640 1 -- start start 2024-08-17T02:29:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 0x7f50cc1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 0x7f50cc15bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.511 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc15a580 con 0x7f50cc06db70 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc15a860 con 0x7f50cc158fb0 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.509+0000 7f50cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc15ab40 con 0x7f50cc06d7a0 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45834/0 (socket says 172.21.15.110:45834) 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 -- 172.21.15.110:0/2545330279 learned_addr learned my addr 172.21.15.110:0/2545330279 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50caa00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 0x7f50cc1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 -- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 msgr2=0x7f50cc1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 0x7f50cc1472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 -- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 msgr2=0x7f50cc15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50cb400640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 0x7f50cc15bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 0x7f50cc15bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 -- 172.21.15.110:0/2545330279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4009450 con 0x7f50cc06db70 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50caa00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 0x7f50cc1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:55.512 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50cb400640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 0x7f50cc15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.510+0000 7f50c2000640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50b4035040 tx=0x7f50b4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.511+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4031b30 con 0x7f50cc06db70 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.511+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4031cd0 con 0x7f50cc06db70 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.511+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b403e6a0 con 0x7f50cc06db70 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.511+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc15ae20 con 0x7f50cc06db70 2024-08-17T02:29:55.513 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.511+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc147820 con 0x7f50cc06db70 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.512+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc0c0630 con 0x7f50cc06db70 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.513+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50b403ea90 con 0x7f50cc06db70 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.513+0000 7f50c2a00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 0x7f50a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.513+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f50b402ae40 con 0x7f50cc06db70 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.514+0000 7f50caa00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 0x7f50a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.514+0000 7f50caa00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 0x7f50a8067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0027e0 tx=0x7f50bc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.517+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f50cc0c0630 con 0x7f50cc06db70 2024-08-17T02:29:55.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.693+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50cc0c0630 con 0x7f50cc06db70 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.693+0000 7f50c2a00640 1 -- 172.21.15.110:0/2545330279 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f50cc0c0630 con 0x7f50cc06db70 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout: "poolnum": 1, 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout: "poolname": ".mgr" 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:29:55.694 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 msgr2=0x7f50a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 0x7f50a8067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0027e0 tx=0x7f50bc009040 comp rx=0 tx=0).stop 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 msgr2=0x7f50cc15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f50b4035040 tx=0x7f50b4032000 comp rx=0 tx=0).stop 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 shutdown_connections 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f50a8065150 0x7f50a8067600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50cc158fb0 0x7f50cc15bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50cc06db70 0x7f50cc15b850 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 --2- 172.21.15.110:0/2545330279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50cc06d7a0 0x7f50cc1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 >> 172.21.15.110:0/2545330279 conn(0x7f50cc067750 msgr2=0x7f50cc069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.695+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 shutdown_connections 2024-08-17T02:29:55.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.696+0000 7f50cbe00640 1 -- 172.21.15.110:0/2545330279 wait complete. 2024-08-17T02:29:55.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:29:55.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:29:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.863+0000 7f1d25200640 1 Processor -- start 2024-08-17T02:29:55.864 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.863+0000 7f1d25200640 1 -- start start 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.864+0000 7f1d25200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d200b0a80 0x7f1d200b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.864+0000 7f1d25200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d20157070 con 0x7f1d200adec0 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.864+0000 7f1d25200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2015b410 con 0x7f1d20157e10 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.864+0000 7f1d25200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200b1390 con 0x7f1d200b0a80 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d200b0a80 0x7f1d200b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1e800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f1d200adec0 0x7f1d2015a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33254/0 (socket says 172.21.15.110:33254) 2024-08-17T02:29:55.865 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1e800640 1 -- 172.21.15.110:0/1015840352 learned_addr learned my addr 172.21.15.110:0/1015840352 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:55.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1de00640 1 -- 172.21.15.110:0/1015840352 >> v1:172.21.15.177:6789/0 conn(0x7f1d20157e10 legacy=0x7f1d200ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:55.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1de00640 1 -- 172.21.15.110:0/1015840352 >> v1:172.21.15.110:6789/0 conn(0x7f1d200adec0 legacy=0x7f1d2015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1de00640 1 -- 172.21.15.110:0/1015840352 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20157330 con 0x7f1d200b0a80 2024-08-17T02:29:55.866 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.865+0000 7f1d1d400640 1 -- 172.21.15.110:0/1015840352 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937674187 0 0) 0x7f1d20157070 con 0x7f1d200adec0 2024-08-17T02:29:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.866+0000 7f1d1de00640 1 --2- 172.21.15.110:0/1015840352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200b0a80 0x7f1d200b0e50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009850 tx=0x7f1d100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4892399e4dc1d2b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.866+0000 7f1d1d400640 1 -- 172.21.15.110:0/1015840352 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1002ad00 con 0x7f1d200b0a80 2024-08-17T02:29:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.866+0000 7f1d1d400640 1 -- 172.21.15.110:0/1015840352 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1002ae60 con 0x7f1d200b0a80 2024-08-17T02:29:55.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.866+0000 7f1d1d400640 1 -- 172.21.15.110:0/1015840352 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10032670 con 0x7f1d200b0a80 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 -- 172.21.15.110:0/1015840352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200b0a80 msgr2=0x7f1d200b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 --2- 172.21.15.110:0/1015840352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200b0a80 0x7f1d200b0e50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009850 tx=0x7f1d100090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 -- 172.21.15.110:0/1015840352 shutdown_connections 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 --2- 172.21.15.110:0/1015840352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200b0a80 0x7f1d200b0e50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 -- 172.21.15.110:0/1015840352 >> 172.21.15.110:0/1015840352 conn(0x7f1d20067750 msgr2=0x7f1d200cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 -- 172.21.15.110:0/1015840352 shutdown_connections 2024-08-17T02:29:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.867+0000 7f1d25200640 1 -- 172.21.15.110:0/1015840352 wait complete. 2024-08-17T02:29:55.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.869+0000 7f1d25200640 1 Processor -- start 2024-08-17T02:29:55.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.869+0000 7f1d25200640 1 -- start start 2024-08-17T02:29:55.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d200b0a80 0x7f1d2006de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d20157e10 0x7f1d2006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2014ff60 con 0x7f1d200adec0 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20156a90 con 0x7f1d200b0a80 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d25200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2014f630 con 0x7f1d20157e10 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45844/0 (socket says 172.21.15.110:45844) 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 -- 172.21.15.110:0/3637084297 learned_addr learned my addr 172.21.15.110:0/3637084297 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1e800640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d20157e10 0x7f1d2006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d15400640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d200b0a80 0x7f1d2006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 -- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d20157e10 msgr2=0x7f1d2006e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d20157e10 0x7f1d2006e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 -- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d200b0a80 msgr2=0x7f1d2006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d200b0a80 0x7f1d2006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:55.872 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.870+0000 7f1d1de00640 1 -- 172.21.15.110:0/3637084297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009390 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d1de00640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009360 tx=0x7f1d10032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10032e20 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10031a60 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10031e20 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2014f910 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.871+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d201690e0 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.872+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d20064db0 con 0x7f1d200adec0 2024-08-17T02:29:55.873 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.873+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d10044030 con 0x7f1d200adec0 2024-08-17T02:29:55.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.874+0000 7f1d16000640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 0x7f1cfc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:55.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.874+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1d10042070 con 0x7f1d200adec0 2024-08-17T02:29:55.874 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.874+0000 7f1d15400640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 0x7f1cfc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:55.875 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.875+0000 7f1d15400640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 0x7f1cfc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d200c0c80 tx=0x7f1d08009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:55.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:55.878+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d100710c0 con 0x7f1d200adec0 2024-08-17T02:29:56.051 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.051+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1d200adc80 con 0x7f1d200adec0 2024-08-17T02:29:56.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.696+0000 7f1d16000640 1 -- 172.21.15.110:0/3637084297 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1d100746a0 con 0x7f1d200adec0 2024-08-17T02:29:56.697 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' created 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 msgr2=0x7f1cfc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 0x7f1cfc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1d200c0c80 tx=0x7f1d08009040 comp rx=0 tx=0).stop 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 msgr2=0x7f1d201433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1d10009360 tx=0x7f1d10032000 comp rx=0 tx=0).stop 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 shutdown_connections 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1cfc065150 0x7f1cfc067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d20157e10 0x7f1d2006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d200b0a80 0x7f1d2006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 --2- 172.21.15.110:0/3637084297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d200adec0 0x7f1d201433e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.699+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 >> 172.21.15.110:0/3637084297 conn(0x7f1d20067750 msgr2=0x7f1d201597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.700+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 shutdown_connections 2024-08-17T02:29:56.701 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.701+0000 7f1d25200640 1 -- 172.21.15.110:0/3637084297 wait complete. 2024-08-17T02:29:56.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:29:56.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.877+0000 7f8a9be00640 1 Processor -- start 2024-08-17T02:29:56.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.877+0000 7f8a9be00640 1 -- start start 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a9c155880 0x7f8a9c0ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c0aeb70 0x7f8a9c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9be00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9c157840 con 0x7f8a9c155c50 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9be00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a9c156c30 con 0x7f8a9c155880 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c156f10 con 0x7f8a9c0aeb70 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a9c155880 0x7f8a9c0ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a9c155880 0x7f8a9c0ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45852/0 (socket says 172.21.15.110:45852) 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 -- 172.21.15.110:0/2149657936 learned_addr learned my addr 172.21.15.110:0/2149657936 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 -- 172.21.15.110:0/2149657936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c0aeb70 msgr2=0x7f8a9c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 --2- 172.21.15.110:0/2149657936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c0aeb70 0x7f8a9c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 -- 172.21.15.110:0/2149657936 >> v1:172.21.15.177:6789/0 conn(0x7f8a9c155c50 legacy=0x7f8a9c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:56.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.879+0000 7f8a9aa00640 1 -- 172.21.15.110:0/2149657936 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c1571f0 con 0x7f8a9c155880 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.880+0000 7f8a9aa00640 1 --2- 172.21.15.110:0/2149657936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c0ae630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009910 tx=0x7f8a8c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162be6e55fd8873c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a99600640 1 -- 172.21.15.110:0/2149657936 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c02adb0 con 0x7f8a9c155880 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a99600640 1 -- 172.21.15.110:0/2149657936 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c032440 con 0x7f8a9c155880 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a99600640 1 -- 172.21.15.110:0/2149657936 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c032820 con 0x7f8a9c155880 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 -- 172.21.15.110:0/2149657936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 msgr2=0x7f8a9c0ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2149657936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c0ae630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009910 tx=0x7f8a8c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 -- 172.21.15.110:0/2149657936 shutdown_connections 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2149657936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c0aeb70 0x7f8a9c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2149657936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c0ae630 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 -- 172.21.15.110:0/2149657936 >> 172.21.15.110:0/2149657936 conn(0x7f8a9c067750 msgr2=0x7f8a9c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 -- 172.21.15.110:0/2149657936 shutdown_connections 2024-08-17T02:29:56.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.881+0000 7f8a9be00640 1 -- 172.21.15.110:0/2149657936 wait complete. 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.883+0000 7f8a9be00640 1 Processor -- start 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.883+0000 7f8a9be00640 1 -- start start 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9c0aeb70 0x7f8a9c158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c155c50 0x7f8a9c13e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0a6850 con 0x7f8a9c155880 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c13e900 con 0x7f8a9c0aeb70 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c0a5eb0 con 0x7f8a9c155c50 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45860/0 (socket says 172.21.15.110:45860) 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 -- 172.21.15.110:0/2257333595 learned_addr learned my addr 172.21.15.110:0/2257333595 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9aa00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9c0aeb70 0x7f8a9c158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9b400640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c155c50 0x7f8a9c13e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 -- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c155c50 msgr2=0x7f8a9c13e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c155c50 0x7f8a9c13e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 -- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9c0aeb70 msgr2=0x7f8a9c158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9c0aeb70 0x7f8a9c158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.884+0000 7f8a9a000640 1 -- 172.21.15.110:0/2257333595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c009450 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a9a000640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800b600 tx=0x7f8a880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800f5f0 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8800f750 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8800fb10 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0a6190 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.885+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c159240 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.886+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c14e770 con 0x7f8a9c155880 2024-08-17T02:29:56.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.887+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8a88010480 con 0x7f8a9c155880 2024-08-17T02:29:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.888+0000 7f8a92000640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 0x7f8a7c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.888+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8a88082b70 con 0x7f8a9c155880 2024-08-17T02:29:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.889+0000 7f8a9aa00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 0x7f8a7c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.889+0000 7f8a9aa00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 0x7f8a7c067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c034000 tx=0x7f8a8c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:56.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:56.892+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8a88050f30 con 0x7f8a9c155880 2024-08-17T02:29:57.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.067+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8a9c0a6990 con 0x7f8a9c155880 2024-08-17T02:29:57.702 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.701+0000 7f8a92000640 1 -- 172.21.15.110:0/2257333595 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8a9c0a6990 con 0x7f8a9c155880 2024-08-17T02:29:57.702 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' created 2024-08-17T02:29:57.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.706+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 msgr2=0x7f8a7c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.706+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 0x7f8a7c067600 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c034000 tx=0x7f8a8c032000 comp rx=0 tx=0).stop 2024-08-17T02:29:57.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.706+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 msgr2=0x7f8a9c13de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.706 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.706+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800b600 tx=0x7f8a880091a0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 shutdown_connections 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8a7c065150 0x7f8a7c067600 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9c155c50 0x7f8a9c13e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a9c155880 0x7f8a9c13de80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 --2- 172.21.15.110:0/2257333595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9c0aeb70 0x7f8a9c158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.709+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 >> 172.21.15.110:0/2257333595 conn(0x7f8a9c067750 msgr2=0x7f8a9c14e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:57.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.710+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 shutdown_connections 2024-08-17T02:29:57.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.710+0000 7f8a9be00640 1 -- 172.21.15.110:0/2257333595 wait complete. 2024-08-17T02:29:57.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:29:57.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.890+0000 7f66f3c00640 1 Processor -- start 2024-08-17T02:29:57.891 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.890+0000 7f66f3c00640 1 -- start start 2024-08-17T02:29:57.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.891+0000 7f66f3c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66ec155a80 0x7f66ec06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f3c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec1598f0 con 0x7f66ec0c7db0 2024-08-17T02:29:57.892 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f3c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec159bd0 con 0x7f66ec0c92e0 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f3c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec159eb0 con 0x7f66ec155a80 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66ec155a80 0x7f66ec06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66ec155a80 0x7f66ec06dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45876/0 (socket says 172.21.15.110:45876) 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 -- 172.21.15.110:0/2452985811 learned_addr learned my addr 172.21.15.110:0/2452985811 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66e3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f66ec0c7db0 0x7f66ec0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33262/0 (socket says 172.21.15.110:33262) 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 -- 172.21.15.110:0/2452985811 >> v1:172.21.15.177:6789/0 conn(0x7f66ec0c92e0 legacy=0x7f66ec0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 -- 172.21.15.110:0/2452985811 >> v1:172.21.15.110:6789/0 conn(0x7f66ec0c7db0 legacy=0x7f66ec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.893 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.892+0000 7f66f1200640 1 -- 172.21.15.110:0/2452985811 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec15a190 con 0x7f66ec155a80 2024-08-17T02:29:57.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.893+0000 7f66f1200640 1 --2- 172.21.15.110:0/2452985811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec155a80 0x7f66ec06dc00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009910 tx=0x7f66dc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d3901867e49802 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.893+0000 7f66ebe00640 1 -- 172.21.15.110:0/2452985811 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc032440 con 0x7f66ec155a80 2024-08-17T02:29:57.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66ebe00640 1 -- 172.21.15.110:0/2452985811 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc0325a0 con 0x7f66ec155a80 2024-08-17T02:29:57.894 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66ebe00640 1 -- 172.21.15.110:0/2452985811 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc032980 con 0x7f66ec155a80 2024-08-17T02:29:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 -- 172.21.15.110:0/2452985811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec155a80 msgr2=0x7f66ec06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 --2- 172.21.15.110:0/2452985811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec155a80 0x7f66ec06dc00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66dc009910 tx=0x7f66dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 -- 172.21.15.110:0/2452985811 shutdown_connections 2024-08-17T02:29:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 --2- 172.21.15.110:0/2452985811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec155a80 0x7f66ec06dc00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.895 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 -- 172.21.15.110:0/2452985811 >> 172.21.15.110:0/2452985811 conn(0x7f66ec067750 msgr2=0x7f66ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:57.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 -- 172.21.15.110:0/2452985811 shutdown_connections 2024-08-17T02:29:57.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.894+0000 7f66f3c00640 1 -- 172.21.15.110:0/2452985811 wait complete. 2024-08-17T02:29:57.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.896+0000 7f66f3c00640 1 Processor -- start 2024-08-17T02:29:57.896 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.896+0000 7f66f3c00640 1 -- start start 2024-08-17T02:29:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.896+0000 7f66f3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f3c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66ec0c92e0 0x7f66ec0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f3c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66ec155a80 0x7f66ec0ac660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f3c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec157180 con 0x7f66ec0c7db0 2024-08-17T02:29:57.898 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f3c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec152da0 con 0x7f66ec155a80 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f3c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec1562b0 con 0x7f66ec0c92e0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45890/0 (socket says 172.21.15.110:45890) 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 -- 172.21.15.110:0/1704423240 learned_addr learned my addr 172.21.15.110:0/1704423240 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66e3e00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66ec0c92e0 0x7f66ec0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66ec155a80 0x7f66ec0ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 -- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66ec0c92e0 msgr2=0x7f66ec0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66ec0c92e0 0x7f66ec0ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 -- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66ec155a80 msgr2=0x7f66ec0ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66ec155a80 0x7f66ec0ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.897+0000 7f66f1200640 1 -- 172.21.15.110:0/1704423240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009450 con 0x7f66ec0c7db0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66f1200640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f66dc035040 tx=0x7f66dc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.899 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc031a60 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc031be0 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec156550 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc03b400 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.898+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec156e10 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.899+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec071050 con 0x7f66ec0c7db0 2024-08-17T02:29:57.900 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.900+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f66dc043030 con 0x7f66ec0c7db0 2024-08-17T02:29:57.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.901+0000 7f66e8c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:57.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.901+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f66dc041070 con 0x7f66ec0c7db0 2024-08-17T02:29:57.901 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.901+0000 7f66e3e00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:57.902 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.902+0000 7f66e3e00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 0x7f66c8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66ec15a110 tx=0x7f66d4007e20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:57.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:57.906+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f66dc0a4e60 con 0x7f66ec0c7db0 2024-08-17T02:29:58.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.114+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66ec06aa10 con 0x7f66ec0c7db0 2024-08-17T02:29:58.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.713+0000 7f66e8c00640 1 -- 172.21.15.110:0/1704423240 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f66dc04b0c0 con 0x7f66ec0c7db0 2024-08-17T02:29:58.713 INFO:teuthology.orchestra.run.smithi110.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:29:58.720 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 msgr2=0x7f66c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 0x7f66c8067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f66ec15a110 tx=0x7f66d4007e20 comp rx=0 tx=0).stop 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 msgr2=0x7f66ec0c0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f66dc035040 tx=0x7f66dc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 shutdown_connections 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f66c8065150 0x7f66c8067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f66ec155a80 0x7f66ec0ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.721 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66ec0c92e0 0x7f66ec0ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 --2- 172.21.15.110:0/1704423240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66ec0c7db0 0x7f66ec0c0930 secure :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f66dc035040 tx=0x7f66dc032000 comp rx=0 tx=0).stop 2024-08-17T02:29:58.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.720+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 >> 172.21.15.110:0/1704423240 conn(0x7f66ec067750 msgr2=0x7f66ec0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.721+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 shutdown_connections 2024-08-17T02:29:58.722 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.722+0000 7f66f3c00640 1 -- 172.21.15.110:0/1704423240 wait complete. 2024-08-17T02:29:58.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.902+0000 7f40b1c00640 1 Processor -- start 2024-08-17T02:29:58.903 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.902+0000 7f40b1c00640 1 -- start start 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.903+0000 7f40b1c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f40ac155180 0x7f40ac0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.903+0000 7f40b1c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40ac06e080 0x7f40ac06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40b1c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ac0afc10 con 0x7f40ac155550 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40b1c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac06ea00 con 0x7f40ac06e080 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40b1c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ac0af000 con 0x7f40ac155180 2024-08-17T02:29:58.904 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40ac06e080 0x7f40ac06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40ac06e080 0x7f40ac06e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45898/0 (socket says 172.21.15.110:45898) 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 -- 172.21.15.110:0/2127291400 learned_addr learned my addr 172.21.15.110:0/2127291400 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40aaa00640 1 --2- 172.21.15.110:0/2127291400 >> v2:172.21.15.177:3300/0 conn(0x7f40ac155180 0x7f40ac0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 -- 172.21.15.110:0/2127291400 >> v2:172.21.15.177:3300/0 conn(0x7f40ac155180 msgr2=0x7f40ac0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 --2- 172.21.15.110:0/2127291400 >> v2:172.21.15.177:3300/0 conn(0x7f40ac155180 0x7f40ac0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 -- 172.21.15.110:0/2127291400 >> v1:172.21.15.177:6789/0 conn(0x7f40ac155550 legacy=0x7f40ac0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.905 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.904+0000 7f40ab400640 1 -- 172.21.15.110:0/2127291400 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0af2e0 con 0x7f40ac06e080 2024-08-17T02:29:58.906 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.905+0000 7f40ab400640 1 --2- 172.21.15.110:0/2127291400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac06e080 0x7f40ac06e4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06bc00 tx=0x7f40a400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1f36ad04041a5f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40aa000640 1 -- 172.21.15.110:0/2127291400 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400a2e0 con 0x7f40ac06e080 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40aa000640 1 -- 172.21.15.110:0/2127291400 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a4008510 con 0x7f40ac06e080 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40aa000640 1 -- 172.21.15.110:0/2127291400 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a40088f0 con 0x7f40ac06e080 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 -- 172.21.15.110:0/2127291400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac06e080 msgr2=0x7f40ac06e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2127291400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac06e080 0x7f40ac06e4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f40ac06bc00 tx=0x7f40a400a950 comp rx=0 tx=0).stop 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 -- 172.21.15.110:0/2127291400 shutdown_connections 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2127291400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac06e080 0x7f40ac06e4c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2127291400 >> v2:172.21.15.177:3300/0 conn(0x7f40ac155180 0x7f40ac0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 -- 172.21.15.110:0/2127291400 >> 172.21.15.110:0/2127291400 conn(0x7f40ac0cb9b0 msgr2=0x7f40ac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 -- 172.21.15.110:0/2127291400 shutdown_connections 2024-08-17T02:29:58.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.906+0000 7f40b1c00640 1 -- 172.21.15.110:0/2127291400 wait complete. 2024-08-17T02:29:58.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.908+0000 7f40b1c00640 1 Processor -- start 2024-08-17T02:29:58.908 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.908+0000 7f40b1c00640 1 -- start start 2024-08-17T02:29:58.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40ac06e080 0x7f40ac0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 0x7f40ac0aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac156aa0 con 0x7f40ac155180 2024-08-17T02:29:58.910 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0ab520 con 0x7f40ac06e080 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40b1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac0a8670 con 0x7f40ac155550 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45900/0 (socket says 172.21.15.110:45900) 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 -- 172.21.15.110:0/2914473074 learned_addr learned my addr 172.21.15.110:0/2914473074 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40aaa00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40ac06e080 0x7f40ac0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40ab400640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 0x7f40ac0aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 -- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 msgr2=0x7f40ac0aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 0x7f40ac0aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 -- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40ac06e080 msgr2=0x7f40ac0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40ac06e080 0x7f40ac0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40a2000640 1 -- 172.21.15.110:0/2914473074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a400abf0 con 0x7f40ac155180 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.909+0000 7f40ab400640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 0x7f40ac0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40a2000640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f409400c560 tx=0x7f4094007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011590 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4094011710 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094011ad0 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac0a8950 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.910+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ac0a8f10 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.911+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ac0a9130 con 0x7f40ac155180 2024-08-17T02:29:58.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.912+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f409401b3b0 con 0x7f40ac155180 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.913+0000 7f40a2a00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.913+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40940819e0 con 0x7f40ac155180 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.913+0000 7f40aaa00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:58.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.913+0000 7f40aaa00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 0x7f4088067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f409c009d20 tx=0x7f409c0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:58.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:58.917+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f409404fab0 con 0x7f40ac155180 2024-08-17T02:29:59.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.092+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40ac064db0 con 0x7f40ac155180 2024-08-17T02:29:59.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.093+0000 7f40a2a00640 1 -- 172.21.15.110:0/2914473074 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f4094017070 con 0x7f40ac155180 2024-08-17T02:29:59.094 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:59.094 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:58.115716+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:59.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 msgr2=0x7f4088067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 0x7f4088067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f409c009d20 tx=0x7f409c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 msgr2=0x7f40ac0aaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f409400c560 tx=0x7f4094007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 shutdown_connections 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4088065150 0x7f4088067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40ac155550 0x7f40ac0aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40ac155180 0x7f40ac0aaaa0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 --2- 172.21.15.110:0/2914473074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40ac06e080 0x7f40ac0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.095+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 >> 172.21.15.110:0/2914473074 conn(0x7f40ac0cb9b0 msgr2=0x7f40ac1584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.096+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 shutdown_connections 2024-08-17T02:29:59.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.096+0000 7f40b1c00640 1 -- 172.21.15.110:0/2914473074 wait complete. 2024-08-17T02:29:59.111 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:29:59.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.258+0000 7f8fa7200640 1 Processor -- start 2024-08-17T02:29:59.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.259+0000 7f8fa7200640 1 -- start start 2024-08-17T02:29:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa7200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8fa8155900 0x7f8fa8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fa8158b30 0x7f8fa80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa7200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa8157690 con 0x7f8fa80b0270 2024-08-17T02:29:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa7200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa8156a80 con 0x7f8fa8158b30 2024-08-17T02:29:59.261 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa7200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa8156d60 con 0x7f8fa8155900 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa6800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fa8158b30 0x7f8fa80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8f9d400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8fa80b0270 0x7f8fa8156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33264/0 (socket says 172.21.15.110:33264) 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa6800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fa8158b30 0x7f8fa80ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45904/0 (socket says 172.21.15.110:45904) 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8f9d400640 1 -- 172.21.15.110:0/2974975723 learned_addr learned my addr 172.21.15.110:0/2974975723 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.260+0000 7f8fa5e00640 1 --2- 172.21.15.110:0/2974975723 >> v2:172.21.15.177:3300/0 conn(0x7f8fa8155900 0x7f8fa8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.261+0000 7f8fa6800640 1 -- 172.21.15.110:0/2974975723 >> v2:172.21.15.177:3300/0 conn(0x7f8fa8155900 msgr2=0x7f8fa8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.261+0000 7f8fa6800640 1 --2- 172.21.15.110:0/2974975723 >> v2:172.21.15.177:3300/0 conn(0x7f8fa8155900 0x7f8fa8155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.261+0000 7f8fa6800640 1 -- 172.21.15.110:0/2974975723 >> v1:172.21.15.110:6789/0 conn(0x7f8fa80b0270 legacy=0x7f8fa8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.261+0000 7f8fa5400640 1 -- 172.21.15.110:0/2974975723 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090366150 0 0) 0x7f8fa8157690 con 0x7f8fa80b0270 2024-08-17T02:29:59.262 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.261+0000 7f8fa6800640 1 -- 172.21.15.110:0/2974975723 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8157040 con 0x7f8fa8158b30 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa6800640 1 --2- 172.21.15.110:0/2974975723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa8158b30 0x7f8fa80ae6b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8065fd0 tx=0x7f8fa0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d9771096ca8978 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa5400640 1 -- 172.21.15.110:0/2974975723 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0032660 con 0x7f8fa8158b30 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa5400640 1 -- 172.21.15.110:0/2974975723 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa00327c0 con 0x7f8fa8158b30 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa5400640 1 -- 172.21.15.110:0/2974975723 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0032b60 con 0x7f8fa8158b30 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa7200640 1 -- 172.21.15.110:0/2974975723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa8158b30 msgr2=0x7f8fa80ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa7200640 1 --2- 172.21.15.110:0/2974975723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa8158b30 0x7f8fa80ae6b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8065fd0 tx=0x7f8fa0009780 comp rx=0 tx=0).stop 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa7200640 1 -- 172.21.15.110:0/2974975723 shutdown_connections 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.262+0000 7f8fa7200640 1 --2- 172.21.15.110:0/2974975723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa8158b30 0x7f8fa80ae6b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.263+0000 7f8fa7200640 1 --2- 172.21.15.110:0/2974975723 >> v2:172.21.15.177:3300/0 conn(0x7f8fa8155900 0x7f8fa8155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.263+0000 7f8fa7200640 1 -- 172.21.15.110:0/2974975723 >> 172.21.15.110:0/2974975723 conn(0x7f8fa8067750 msgr2=0x7f8fa80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.264 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.263+0000 7f8fa7200640 1 -- 172.21.15.110:0/2974975723 shutdown_connections 2024-08-17T02:29:59.265 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.263+0000 7f8fa7200640 1 -- 172.21.15.110:0/2974975723 wait complete. 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.264+0000 7f8fa7200640 1 Processor -- start 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.264+0000 7f8fa7200640 1 -- start start 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa8155900 0x7f8fa814db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fa8158b30 0x7f8fa814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8143f50 con 0x7f8fa80b0270 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c4a40 con 0x7f8fa8155900 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80c4d20 con 0x7f8fa8158b30 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.267 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45906/0 (socket says 172.21.15.110:45906) 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa5e00640 1 -- 172.21.15.110:0/833563770 learned_addr learned my addr 172.21.15.110:0/833563770 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8f9d400640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa8155900 0x7f8fa814db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.265+0000 7f8fa6800640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fa8158b30 0x7f8fa814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 -- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fa8158b30 msgr2=0x7f8fa814e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fa8158b30 0x7f8fa814e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 -- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa8155900 msgr2=0x7f8fa814db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa8155900 0x7f8fa814db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 -- 172.21.15.110:0/833563770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009a20 con 0x7f8fa80b0270 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa5e00640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800ea20 tx=0x7f8f980090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9800ca10 con 0x7f8fa80b0270 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9800cb70 con 0x7f8fa80b0270 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa80c5000 con 0x7f8fa80b0270 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f98013470 con 0x7f8fa80b0270 2024-08-17T02:29:59.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.266+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80c55c0 con 0x7f8fa80b0270 2024-08-17T02:29:59.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.267+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa8071050 con 0x7f8fa80b0270 2024-08-17T02:29:59.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.268+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f98013860 con 0x7f8fa80b0270 2024-08-17T02:29:59.269 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.269+0000 7f8f9e000640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 0x7f8f84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.269+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f980827e0 con 0x7f8fa80b0270 2024-08-17T02:29:59.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.269+0000 7f8f9d400640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 0x7f8f84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.270+0000 7f8f9d400640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 0x7f8f84067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8154e50 tx=0x7f8f90009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.273+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f98050800 con 0x7f8fa80b0270 2024-08-17T02:29:59.445 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.445+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fa81440f0 con 0x7f8fa80b0270 2024-08-17T02:29:59.446 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.445+0000 7f8f9e000640 1 -- 172.21.15.110:0/833563770 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f8f98053e20 con 0x7f8fa80b0270 2024-08-17T02:29:59.446 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:29:59.446 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":32,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:58.115716+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 msgr2=0x7f8f84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 0x7f8f84067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8154e50 tx=0x7f8f90009040 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 msgr2=0x7f8fa8143a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8f9800ea20 tx=0x7f8f980090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 shutdown_connections 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8f84065150 0x7f8f84067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fa8158b30 0x7f8fa814e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fa8155900 0x7f8fa814db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 --2- 172.21.15.110:0/833563770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa80b0270 0x7f8fa8143a10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 >> 172.21.15.110:0/833563770 conn(0x7f8fa8067750 msgr2=0x7f8fa80cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.449 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 shutdown_connections 2024-08-17T02:29:59.450 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.448+0000 7f8fa7200640 1 -- 172.21.15.110:0/833563770 wait complete. 2024-08-17T02:29:59.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:29:59.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.613+0000 7fe0ea000640 1 Processor -- start 2024-08-17T02:29:59.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.613+0000 7fe0ea000640 1 -- start start 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0ea000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0e40c7780 0x7fe0e406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0ea000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40c8890 con 0x7fe0e4155490 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0ea000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40adb80 con 0x7fe0e406abc0 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0ea000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e41599f0 con 0x7fe0e40c7780 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0e2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0e40c7780 0x7fe0e406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.614+0000 7fe0e3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe0e4155490 0x7fe0e41558f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33274/0 (socket says 172.21.15.110:33274) 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0e40c7780 0x7fe0e406af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45918/0 (socket says 172.21.15.110:45918) 2024-08-17T02:29:59.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e3e00640 1 -- 172.21.15.110:0/236268172 learned_addr learned my addr 172.21.15.110:0/236268172 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:29:59.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e2a00640 1 -- 172.21.15.110:0/236268172 >> v1:172.21.15.177:6789/0 conn(0x7fe0e406abc0 legacy=0x7fe0e40c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e2a00640 1 -- 172.21.15.110:0/236268172 >> v1:172.21.15.110:6789/0 conn(0x7fe0e4155490 legacy=0x7fe0e41558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e2000640 1 -- 172.21.15.110:0/236268172 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400810129 0 0) 0x7fe0e40c8890 con 0x7fe0e4155490 2024-08-17T02:29:59.616 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.615+0000 7fe0e2a00640 1 -- 172.21.15.110:0/236268172 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40c7c80 con 0x7fe0e40c7780 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.616+0000 7fe0e2a00640 1 --2- 172.21.15.110:0/236268172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e40c7780 0x7fe0e406af90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009850 tx=0x7fe0d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25973f83c339505e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.616+0000 7fe0e2000640 1 -- 172.21.15.110:0/236268172 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d002ad90 con 0x7fe0e40c7780 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.616+0000 7fe0e2000640 1 -- 172.21.15.110:0/236268172 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d0032440 con 0x7fe0e40c7780 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.616+0000 7fe0e2000640 1 -- 172.21.15.110:0/236268172 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d00327e0 con 0x7fe0e40c7780 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 -- 172.21.15.110:0/236268172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e40c7780 msgr2=0x7fe0e406af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 --2- 172.21.15.110:0/236268172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e40c7780 0x7fe0e406af90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009850 tx=0x7fe0d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 -- 172.21.15.110:0/236268172 shutdown_connections 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 --2- 172.21.15.110:0/236268172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e40c7780 0x7fe0e406af90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 -- 172.21.15.110:0/236268172 >> 172.21.15.110:0/236268172 conn(0x7fe0e40cd4b0 msgr2=0x7fe0e40c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 -- 172.21.15.110:0/236268172 shutdown_connections 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.617+0000 7fe0ea000640 1 -- 172.21.15.110:0/236268172 wait complete. 2024-08-17T02:29:59.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.618+0000 7fe0ea000640 1 Processor -- start 2024-08-17T02:29:59.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.618+0000 7fe0ea000640 1 -- start start 2024-08-17T02:29:59.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e406abc0 0x7fe0e4158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0e40c7780 0x7fe0e4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4159030 con 0x7fe0e4155490 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4154000 con 0x7fe0e406abc0 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0ea000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4150650 con 0x7fe0e40c7780 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.619+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45930/0 (socket says 172.21.15.110:45930) 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 -- 172.21.15.110:0/3018550996 learned_addr learned my addr 172.21.15.110:0/3018550996 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e2a00640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0e40c7780 0x7fe0e4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3400640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e406abc0 0x7fe0e4158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 -- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0e40c7780 msgr2=0x7fe0e4150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0e40c7780 0x7fe0e4150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 -- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e406abc0 msgr2=0x7fe0e4158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e406abc0 0x7fe0e4158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:59.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 -- 172.21.15.110:0/3018550996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0009390 con 0x7fe0e4155490 2024-08-17T02:29:59.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0e3e00640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00cbf0 tx=0x7fe0dc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.620+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00ce10 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.621+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00a850 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.621+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00ac50 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.621+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e4153d20 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.621+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e41582f0 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.622+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e4071050 con 0x7fe0e4155490 2024-08-17T02:29:59.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.622+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe0dc007300 con 0x7fe0e4155490 2024-08-17T02:29:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.623+0000 7fe0daa00640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 0x7fe0c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.623+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe0dc0824d0 con 0x7fe0e4155490 2024-08-17T02:29:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.623+0000 7fe0e3400640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 0x7fe0c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:59.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.624+0000 7fe0e3400640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 0x7fe0c4067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4007fd0 tx=0x7fe0d4007e30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:59.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.627+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe0dc050620 con 0x7fe0e4155490 2024-08-17T02:29:59.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:29:59.840+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe0e406e8c0 con 0x7fe0e4155490 2024-08-17T02:30:00.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.735+0000 7fe0daa00640 1 -- 172.21.15.110:0/3018550996 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0dc00b0d0 con 0x7fe0e4155490 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 msgr2=0x7fe0c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 0x7fe0c4067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4007fd0 tx=0x7fe0d4007e30 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 msgr2=0x7fe0e4150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00cbf0 tx=0x7fe0dc0019b0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 shutdown_connections 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe0c4065150 0x7fe0c4067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0e4155490 0x7fe0e4150aa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0e40c7780 0x7fe0e4150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 --2- 172.21.15.110:0/3018550996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0e406abc0 0x7fe0e4158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 >> 172.21.15.110:0/3018550996 conn(0x7fe0e40cd4b0 msgr2=0x7fe0e41521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 shutdown_connections 2024-08-17T02:30:00.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.738+0000 7fe0ea000640 1 -- 172.21.15.110:0/3018550996 wait complete. 2024-08-17T02:30:00.757 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:30:00.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.913+0000 7f5396400640 1 Processor -- start 2024-08-17T02:30:00.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.913+0000 7f5396400640 1 -- start start 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f5396400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f53900c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f5396400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53900adcf0 0x7f53900ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f5396400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53900ab130 con 0x7f53900abb00 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f5396400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53900ae5a0 con 0x7f53900adcf0 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f5396400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53900ae2c0 con 0x7f5390156c50 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f538ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53900adcf0 0x7f53900ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f538ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53900adcf0 0x7f53900ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45946/0 (socket says 172.21.15.110:45946) 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.914+0000 7f538ea00640 1 -- 172.21.15.110:0/2845539430 learned_addr learned my addr 172.21.15.110:0/2845539430 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:00.915 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.915+0000 7f538f400640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f53900c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.915+0000 7f538ea00640 1 -- 172.21.15.110:0/2845539430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 msgr2=0x7f53900c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:00.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.915+0000 7f538ea00640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f53900c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.915+0000 7f538ea00640 1 -- 172.21.15.110:0/2845539430 >> v1:172.21.15.177:6789/0 conn(0x7f53900abb00 legacy=0x7f53900c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.915+0000 7f538ea00640 1 -- 172.21.15.110:0/2845539430 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53900aaae0 con 0x7f53900adcf0 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.916+0000 7f538ea00640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900adcf0 0x7f53900ab5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f537c009910 tx=0x7f537c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1aa83d81ce789c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.916+0000 7f538e000640 1 -- 172.21.15.110:0/2845539430 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c02adb0 con 0x7f53900adcf0 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.916+0000 7f538e000640 1 -- 172.21.15.110:0/2845539430 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537c032440 con 0x7f53900adcf0 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.916+0000 7f538e000640 1 -- 172.21.15.110:0/2845539430 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f537c032820 con 0x7f53900adcf0 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 -- 172.21.15.110:0/2845539430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900adcf0 msgr2=0x7f53900ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900adcf0 0x7f53900ab5c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f537c009910 tx=0x7f537c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 -- 172.21.15.110:0/2845539430 shutdown_connections 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900adcf0 0x7f53900ab5c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 --2- 172.21.15.110:0/2845539430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f53900c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 -- 172.21.15.110:0/2845539430 >> 172.21.15.110:0/2845539430 conn(0x7f5390067750 msgr2=0x7f53900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:00.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 -- 172.21.15.110:0/2845539430 shutdown_connections 2024-08-17T02:30:00.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.917+0000 7f5396400640 1 -- 172.21.15.110:0/2845539430 wait complete. 2024-08-17T02:30:00.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.918+0000 7f5396400640 1 Processor -- start 2024-08-17T02:30:00.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.918+0000 7f5396400640 1 -- start start 2024-08-17T02:30:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 0x7f539016d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f5390149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539016d5a0 con 0x7f53900abb00 2024-08-17T02:30:00.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539006d9e0 con 0x7f53900adcf0 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.919+0000 7f5396400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5390150da0 con 0x7f5390156c50 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45952/0 (socket says 172.21.15.110:45952) 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 -- 172.21.15.110:0/2875755534 learned_addr learned my addr 172.21.15.110:0/2875755534 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538ea00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 0x7f539016d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538fe00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f5390149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 -- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 msgr2=0x7f5390149600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f5390149600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 -- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 msgr2=0x7f539016d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 0x7f539016d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 -- 172.21.15.110:0/2875755534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537c009450 con 0x7f53900abb00 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538ea00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 0x7f539016d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538fe00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f5390149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:00.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f538f400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f538000e900 tx=0x7f53800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.920+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000c8e0 con 0x7f53900abb00 2024-08-17T02:30:00.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.921+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000ca40 con 0x7f53900abb00 2024-08-17T02:30:00.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.921+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000cde0 con 0x7f53900abb00 2024-08-17T02:30:00.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.921+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5390151080 con 0x7f53900abb00 2024-08-17T02:30:00.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.921+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5390151640 con 0x7f53900abb00 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.922+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5390071050 con 0x7f53900abb00 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.922+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5380013680 con 0x7f53900abb00 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.923+0000 7f5386a00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 0x7f5370067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.923+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53800826a0 con 0x7f53900abb00 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.923+0000 7f538ea00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 0x7f5370067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:00.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.924+0000 7f538ea00640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 0x7f5370067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f537c034000 tx=0x7f537c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:00.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:00.931+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5380050780 con 0x7f53900abb00 2024-08-17T02:30:01.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.141+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f539014d1f0 con 0x7f53900abb00 2024-08-17T02:30:01.678 INFO:tasks.ceph.mds.a.smithi110.stderr:2024-08-17T02:30:01.678+0000 7f8bc4e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:01.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.741+0000 7f5386a00640 1 -- 172.21.15.110:0/2875755534 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5380053da0 con 0x7f53900abb00 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 msgr2=0x7f5370067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 0x7f5370067600 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f537c034000 tx=0x7f537c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 msgr2=0x7f539014a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f538000e900 tx=0x7f53800090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 shutdown_connections 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5370065150 0x7f5370067600 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5390156c50 0x7f5390149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53900adcf0 0x7f539016d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 --2- 172.21.15.110:0/2875755534 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53900abb00 0x7f539014a740 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 >> 172.21.15.110:0/2875755534 conn(0x7f5390067750 msgr2=0x7f53901537d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 shutdown_connections 2024-08-17T02:30:01.744 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.743+0000 7f5396400640 1 -- 172.21.15.110:0/2875755534 wait complete. 2024-08-17T02:30:01.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.908+0000 7fc4ce800640 1 Processor -- start 2024-08-17T02:30:01.909 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.908+0000 7fc4ce800640 1 -- start start 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4ce800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 0x7fc4c80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4ce800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4c806dc80 0x7fc4c81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4ce800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80caaf0 con 0x7fc4c8156ea0 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4ce800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80ca900 con 0x7fc4c806dc80 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4ce800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80cc560 con 0x7fc4c8156ad0 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4c806dc80 0x7fc4c81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4c806dc80 0x7fc4c81577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45962/0 (socket says 172.21.15.110:45962) 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 -- 172.21.15.110:0/4137553675 learned_addr learned my addr 172.21.15.110:0/4137553675 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cd400640 1 --2- 172.21.15.110:0/4137553675 >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 0x7fc4c80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 -- 172.21.15.110:0/4137553675 >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 msgr2=0x7fc4c80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 --2- 172.21.15.110:0/4137553675 >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 0x7fc4c80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 -- 172.21.15.110:0/4137553675 >> v1:172.21.15.177:6789/0 conn(0x7fc4c8156ea0 legacy=0x7fc4c806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:01.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cde00640 1 -- 172.21.15.110:0/4137553675 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c8157300 con 0x7fc4c806dc80 2024-08-17T02:30:01.912 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.910+0000 7fc4cd400640 1 --2- 172.21.15.110:0/4137553675 >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 0x7fc4c80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.911+0000 7fc4cde00640 1 --2- 172.21.15.110:0/4137553675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c806dc80 0x7fc4c81577f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8065fd0 tx=0x7fc4c0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441b7cc8c0cdf7ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4c7e00640 1 -- 172.21.15.110:0/4137553675 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0031400 con 0x7fc4c806dc80 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4c7e00640 1 -- 172.21.15.110:0/4137553675 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c002d050 con 0x7fc4c806dc80 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4c7e00640 1 -- 172.21.15.110:0/4137553675 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0031790 con 0x7fc4c806dc80 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 -- 172.21.15.110:0/4137553675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c806dc80 msgr2=0x7fc4c81577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 --2- 172.21.15.110:0/4137553675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c806dc80 0x7fc4c81577f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8065fd0 tx=0x7fc4c0009840 comp rx=0 tx=0).stop 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 -- 172.21.15.110:0/4137553675 shutdown_connections 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 --2- 172.21.15.110:0/4137553675 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c806dc80 0x7fc4c81577f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.913 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 --2- 172.21.15.110:0/4137553675 >> v2:172.21.15.177:3300/0 conn(0x7fc4c8156ad0 0x7fc4c80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 -- 172.21.15.110:0/4137553675 >> 172.21.15.110:0/4137553675 conn(0x7fc4c8067750 msgr2=0x7fc4c80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 -- 172.21.15.110:0/4137553675 shutdown_connections 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.912+0000 7fc4ce800640 1 -- 172.21.15.110:0/4137553675 wait complete. 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.914+0000 7fc4ce800640 1 Processor -- start 2024-08-17T02:30:01.914 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.914+0000 7fc4ce800640 1 -- start start 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 0x7fc4c80c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 0x7fc4c8142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8158e10 con 0x7fc4c8156ad0 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c6c10 con 0x7fc4c8156ea0 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4ce800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c6ef0 con 0x7fc4c806dc80 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45972/0 (socket says 172.21.15.110:45972) 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 -- 172.21.15.110:0/3597459255 learned_addr learned my addr 172.21.15.110:0/3597459255 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cde00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 0x7fc4c8142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cd400640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 0x7fc4c80c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 -- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 msgr2=0x7fc4c80c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 0x7fc4c80c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 -- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 msgr2=0x7fc4c8142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 0x7fc4c8142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cca00640 1 -- 172.21.15.110:0/3597459255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0009ae0 con 0x7fc4c8156ad0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cd400640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 0x7fc4c80c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.915+0000 7fc4cde00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 0x7fc4c8142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4cca00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b4f0 tx=0x7fc4b40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400f510 con 0x7fc4c8156ad0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400f670 con 0x7fc4c8156ad0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80c71d0 con 0x7fc4c8156ad0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400fa70 con 0x7fc4c8156ad0 2024-08-17T02:30:01.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.916+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80c7790 con 0x7fc4c8156ad0 2024-08-17T02:30:01.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.917+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c8071050 con 0x7fc4c8156ad0 2024-08-17T02:30:01.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.918+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc4b401a400 con 0x7fc4c8156ad0 2024-08-17T02:30:01.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.919+0000 7fc4c4c00640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 0x7fc4a8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:01.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.919+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4b4081fd0 con 0x7fc4c8156ad0 2024-08-17T02:30:01.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.919+0000 7fc4cd400640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 0x7fc4a8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:01.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.919+0000 7fc4cd400640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 0x7fc4a8067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00ab50 tx=0x7fc4bc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:01.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:01.922+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc4b4050070 con 0x7fc4c8156ad0 2024-08-17T02:30:02.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.129+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c8168d00 con 0x7fc4c8156ad0 2024-08-17T02:30:02.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.130+0000 7fc4c4c00640 1 -- 172.21.15.110:0/3597459255 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fc4b4053690 con 0x7fc4c8156ad0 2024-08-17T02:30:02.131 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:02.131 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:30:02.131 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 17 2024-08-17T02:30:02.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 msgr2=0x7fc4a8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 0x7fc4a8067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc00ab50 tx=0x7fc4bc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 msgr2=0x7fc4c81588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b4f0 tx=0x7fc4b40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 shutdown_connections 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4a8065150 0x7fc4a8067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4c8156ea0 0x7fc4c8142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4c8156ad0 0x7fc4c81588d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 --2- 172.21.15.110:0/3597459255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4c806dc80 0x7fc4c80c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 >> 172.21.15.110:0/3597459255 conn(0x7fc4c8067750 msgr2=0x7fc4c8068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 shutdown_connections 2024-08-17T02:30:02.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.132+0000 7fc4ce800640 1 -- 172.21.15.110:0/3597459255 wait complete. 2024-08-17T02:30:02.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:30:02.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.295+0000 7fe50ea00640 1 Processor -- start 2024-08-17T02:30:02.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.295+0000 7fe50ea00640 1 -- start start 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe508155a20 0x7fe5080adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe50806df00 0x7fe5080ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508156670 con 0x7fe508155df0 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5080b0350 con 0x7fe508155a20 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ea00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50806e5e0 con 0x7fe50806df00 2024-08-17T02:30:02.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe508155a20 0x7fe5080adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe508155a20 0x7fe5080adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45978/0 (socket says 172.21.15.110:45978) 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 -- 172.21.15.110:0/1340788812 learned_addr learned my addr 172.21.15.110:0/1340788812 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe50ca00640 1 --2- 172.21.15.110:0/1340788812 >> v2:172.21.15.177:3300/0 conn(0x7fe50806df00 0x7fe5080ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 -- 172.21.15.110:0/1340788812 >> v2:172.21.15.177:3300/0 conn(0x7fe50806df00 msgr2=0x7fe5080ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 --2- 172.21.15.110:0/1340788812 >> v2:172.21.15.177:3300/0 conn(0x7fe50806df00 0x7fe5080ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 -- 172.21.15.110:0/1340788812 >> v1:172.21.15.177:6789/0 conn(0x7fe508155df0 legacy=0x7fe50806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:02.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.297+0000 7fe507e00640 1 -- 172.21.15.110:0/1340788812 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50806e8c0 con 0x7fe508155a20 2024-08-17T02:30:02.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.298+0000 7fe507e00640 1 --2- 172.21.15.110:0/1340788812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155a20 0x7fe5080adf10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe5081565e0 tx=0x7fe4f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781b66b43d7bd11f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe507400640 1 -- 172.21.15.110:0/1340788812 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f802ad50 con 0x7fe508155a20 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe507400640 1 -- 172.21.15.110:0/1340788812 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8032440 con 0x7fe508155a20 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe507400640 1 -- 172.21.15.110:0/1340788812 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8032820 con 0x7fe508155a20 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 -- 172.21.15.110:0/1340788812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155a20 msgr2=0x7fe5080adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 --2- 172.21.15.110:0/1340788812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155a20 0x7fe5080adf10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe5081565e0 tx=0x7fe4f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 -- 172.21.15.110:0/1340788812 shutdown_connections 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 --2- 172.21.15.110:0/1340788812 >> v2:172.21.15.177:3300/0 conn(0x7fe50806df00 0x7fe5080ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 --2- 172.21.15.110:0/1340788812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155a20 0x7fe5080adf10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 -- 172.21.15.110:0/1340788812 >> 172.21.15.110:0/1340788812 conn(0x7fe5080cb9b0 msgr2=0x7fe5080cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 -- 172.21.15.110:0/1340788812 shutdown_connections 2024-08-17T02:30:02.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.299+0000 7fe50ea00640 1 -- 172.21.15.110:0/1340788812 wait complete. 2024-08-17T02:30:02.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.301+0000 7fe50ea00640 1 Processor -- start 2024-08-17T02:30:02.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.301+0000 7fe50ea00640 1 -- start start 2024-08-17T02:30:02.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe50806df00 0x7fe5080ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe508155a20 0x7fe5080c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080c3440 con 0x7fe508155df0 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080c3ec0 con 0x7fe50806df00 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080c2830 con 0x7fe508155a20 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe4ff400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe508155a20 0x7fe5080c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:45990/0 (socket says 172.21.15.110:45990) 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe507e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe50806df00 0x7fe5080ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.302+0000 7fe50ca00640 1 -- 172.21.15.110:0/3812954268 learned_addr learned my addr 172.21.15.110:0/3812954268 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:02.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 -- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe508155a20 msgr2=0x7fe5080c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe508155a20 0x7fe5080c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 -- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe50806df00 msgr2=0x7fe5080ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.304 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe50806df00 0x7fe5080ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 -- 172.21.15.110:0/3812954268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f8009450 con 0x7fe508155df0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ca00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe50000ceb0 tx=0x7fe500007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500016430 con 0x7fe508155df0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe500016590 con 0x7fe508155df0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500016930 con 0x7fe508155df0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080c2b10 con 0x7fe508155df0 2024-08-17T02:30:02.305 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.303+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5080c30d0 con 0x7fe508155df0 2024-08-17T02:30:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.304+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080c35f0 con 0x7fe508155df0 2024-08-17T02:30:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.305+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe500003020 con 0x7fe508155df0 2024-08-17T02:30:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.306+0000 7fe4ffe00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 0x7fe4e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.306+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe500012070 con 0x7fe508155df0 2024-08-17T02:30:02.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.306+0000 7fe507e00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 0x7fe4e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.307+0000 7fe507e00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 0x7fe4e4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.310+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe5080c35f0 con 0x7fe508155df0 2024-08-17T02:30:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.485+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5080c35f0 con 0x7fe508155df0 2024-08-17T02:30:02.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.486+0000 7fe4ffe00640 1 -- 172.21.15.110:0/3812954268 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fe5080c35f0 con 0x7fe508155df0 2024-08-17T02:30:02.487 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:02.487 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":33,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:29:59.709419+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:30:02.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 msgr2=0x7fe4e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 0x7fe4e4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8034000 tx=0x7fe4f8032000 comp rx=0 tx=0).stop 2024-08-17T02:30:02.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 msgr2=0x7fe5080c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe50000ceb0 tx=0x7fe500007840 comp rx=0 tx=0).stop 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 shutdown_connections 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe4e4065150 0x7fe4e4067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe508155df0 0x7fe5080c2200 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe508155a20 0x7fe5080c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 --2- 172.21.15.110:0/3812954268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe50806df00 0x7fe5080ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 >> 172.21.15.110:0/3812954268 conn(0x7fe5080cb9b0 msgr2=0x7fe508158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 shutdown_connections 2024-08-17T02:30:02.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.489+0000 7fe50ea00640 1 -- 172.21.15.110:0/3812954268 wait complete. 2024-08-17T02:30:02.505 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:30:02.505 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:02.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.655+0000 7f965ac00640 1 Processor -- start 2024-08-17T02:30:02.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.655+0000 7f965ac00640 1 -- start start 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f965ac00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96540cbea0 0x7f9654156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f965ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f96541577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f965ac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540cc300 con 0x7f9654156ad0 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f965ac00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540ca900 con 0x7f96540cbea0 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f965ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540cc560 con 0x7f965406dc80 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.656+0000 7f9658e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96540cbea0 0x7f9654156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f965a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f96541577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f96540cbea0 0x7f9654156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46000/0 (socket says 172.21.15.110:46000) 2024-08-17T02:30:02.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 -- 172.21.15.110:0/2358640427 learned_addr learned my addr 172.21.15.110:0/2358640427 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9659800640 1 --1- 172.21.15.110:0/2358640427 >> v1:172.21.15.177:6789/0 conn(0x7f9654156ad0 0x7f965406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:46434/0 (socket says 172.21.15.110:46434) 2024-08-17T02:30:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 -- 172.21.15.110:0/2358640427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 msgr2=0x7f96541577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 --2- 172.21.15.110:0/2358640427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f96541577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 -- 172.21.15.110:0/2358640427 >> v1:172.21.15.177:6789/0 conn(0x7f9654156ad0 legacy=0x7f965406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.657+0000 7f9658e00640 1 -- 172.21.15.110:0/2358640427 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540caaf0 con 0x7f96540cbea0 2024-08-17T02:30:02.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.658+0000 7f9658e00640 1 --2- 172.21.15.110:0/2358640427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f9654156ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9640009910 tx=0x7f96400091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5d6d6101fdb391 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.658+0000 7f9653e00640 1 -- 172.21.15.110:0/2358640427 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964002ae40 con 0x7f96540cbea0 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.658+0000 7f9653e00640 1 -- 172.21.15.110:0/2358640427 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640032440 con 0x7f96540cbea0 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.658+0000 7f9653e00640 1 -- 172.21.15.110:0/2358640427 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640032820 con 0x7f96540cbea0 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 -- 172.21.15.110:0/2358640427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 msgr2=0x7f9654156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 --2- 172.21.15.110:0/2358640427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f9654156ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9640009910 tx=0x7f96400091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 -- 172.21.15.110:0/2358640427 shutdown_connections 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 --2- 172.21.15.110:0/2358640427 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f96541577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 --2- 172.21.15.110:0/2358640427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f9654156ea0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 -- 172.21.15.110:0/2358640427 >> 172.21.15.110:0/2358640427 conn(0x7f9654067750 msgr2=0x7f96540cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 -- 172.21.15.110:0/2358640427 shutdown_connections 2024-08-17T02:30:02.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.659+0000 7f965ac00640 1 -- 172.21.15.110:0/2358640427 wait complete. 2024-08-17T02:30:02.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.661+0000 7f965ac00640 1 Processor -- start 2024-08-17T02:30:02.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.661+0000 7f965ac00640 1 -- start start 2024-08-17T02:30:02.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f9654169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9654156ad0 0x7f96540a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965416a3d0 con 0x7f96540cbea0 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c7430 con 0x7f9654156ad0 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96540c6900 con 0x7f965406dc80 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46010/0 (socket says 172.21.15.110:46010) 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 -- 172.21.15.110:0/541023749 learned_addr learned my addr 172.21.15.110:0/541023749 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f965a200640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9654156ad0 0x7f96540a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9659800640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f9654169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 -- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 msgr2=0x7f9654169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f9654169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 -- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9654156ad0 msgr2=0x7f96540a87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9654156ad0 0x7f96540a87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.662+0000 7f9658e00640 1 -- 172.21.15.110:0/541023749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640009450 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f9658e00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9640009970 tx=0x7f9640032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640031c80 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640031e00 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964003d670 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96540c6b90 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.663+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96540c7150 con 0x7f96540cbea0 2024-08-17T02:30:02.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.665+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965416a580 con 0x7f96540cbea0 2024-08-17T02:30:02.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.665+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9640039040 con 0x7f96540cbea0 2024-08-17T02:30:02.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.666+0000 7f9650c00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 0x7f9634067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:02.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.666+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f964002ae40 con 0x7f96540cbea0 2024-08-17T02:30:02.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.667+0000 7f9659800640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 0x7f9634067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:02.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.667+0000 7f9659800640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 0x7f9634067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f965416c5c0 tx=0x7f9648007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:02.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.671+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f965416a580 con 0x7f96540cbea0 2024-08-17T02:30:02.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.847+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f965416a580 con 0x7f9634065150 2024-08-17T02:30:02.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.855+0000 7f9650c00640 1 -- 172.21.15.110:0/541023749 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253850 (secure 0 0 0) 0x7f965416a580 con 0x7f9634065150 2024-08-17T02:30:02.858 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:02.860 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:30:02.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 msgr2=0x7f9634067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 0x7f9634067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f965416c5c0 tx=0x7f9648007cc0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 msgr2=0x7f96540c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:02.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9640009970 tx=0x7f9640032000 comp rx=0 tx=0).stop 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 shutdown_connections 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9634065150 0x7f9634067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9654156ad0 0x7f96540a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96540cbea0 0x7f96540c63c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 --2- 172.21.15.110:0/541023749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f965406dc80 0x7f9654169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 >> 172.21.15.110:0/541023749 conn(0x7f9654067750 msgr2=0x7f9654153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 shutdown_connections 2024-08-17T02:30:02.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:02.859+0000 7f965ac00640 1 -- 172.21.15.110:0/541023749 wait complete. 2024-08-17T02:30:02.875 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:30:01.446762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399240,"kb_used_data":3740,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575480,"statfs":{"total":773094113280,"available":770637291520,"internally_reserved":0,"allocated":3829760,"data_stored":2153731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746875"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706547+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.699111+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701797+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706718+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:46.577204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704171+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:41.895748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703508+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701738+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.705153+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:29.801664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.702579+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:21.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698523+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701212+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:21.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703243+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:42.644489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703500+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:57.436575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701757+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701233+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704773+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.702806+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704691+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:32.283441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704106+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:27.260276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704491+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:55.389423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698232+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706519+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:46.678605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704661+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:55.089547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701055+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701388+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698077+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701219+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.697738+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701234+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703960+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:46.894627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701661+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706607+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-08-17T02:29:52.474845+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:52.474845+0000","last_peered":"2024-08-17T02:29:52.474845+0000","last_clean":"2024-08-17T02:29:52.474845+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:52.474845+0000","last_undegraded":"2024-08-17T02:29:52.474845+0000","last_fullsized":"2024-08-17T02:29:52.474845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":925696,"data_stored":712718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":319488,"data_stored":116545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":925696,"data_stored":712718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:02.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:03.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.068+0000 7f4057a00640 1 Processor -- start 2024-08-17T02:30:03.068 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.068+0000 7f4057a00640 1 -- start start 2024-08-17T02:30:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4057a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f405015c230 0x7f405006be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4057a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f4050066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4057a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405006b9d0 con 0x7f405015c600 2024-08-17T02:30:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4057a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405006ebf0 con 0x7f405015c230 2024-08-17T02:30:03.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4057a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40500aad80 con 0x7f40500aa8f0 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4055000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f405015c230 0x7f405006be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4055000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f405015c230 0x7f405006be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46016/0 (socket says 172.21.15.110:46016) 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.069+0000 7f4055000640 1 -- 172.21.15.110:0/1081701092 learned_addr learned my addr 172.21.15.110:0/1081701092 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.070+0000 7f4055a00640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f4050066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.070+0000 7f4055000640 1 -- 172.21.15.110:0/1081701092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 msgr2=0x7f4050066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.070+0000 7f4055000640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f4050066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.070+0000 7f4055000640 1 -- 172.21.15.110:0/1081701092 >> v1:172.21.15.177:6789/0 conn(0x7f405015c600 legacy=0x7f405006e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:03.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.070+0000 7f4055000640 1 -- 172.21.15.110:0/1081701092 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40500ab060 con 0x7f405015c230 2024-08-17T02:30:03.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.071+0000 7f4055000640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405006be60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4044009910 tx=0x7f40440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e9e12ea3db6c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.071+0000 7f404f400640 1 -- 172.21.15.110:0/1081701092 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404402adb0 con 0x7f405015c230 2024-08-17T02:30:03.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.071+0000 7f404f400640 1 -- 172.21.15.110:0/1081701092 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4044032440 con 0x7f405015c230 2024-08-17T02:30:03.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.071+0000 7f404f400640 1 -- 172.21.15.110:0/1081701092 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044032820 con 0x7f405015c230 2024-08-17T02:30:03.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 -- 172.21.15.110:0/1081701092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 msgr2=0x7f405006be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405006be60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4044009910 tx=0x7f40440091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 -- 172.21.15.110:0/1081701092 shutdown_connections 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f4050066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 --2- 172.21.15.110:0/1081701092 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405006be60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 -- 172.21.15.110:0/1081701092 >> 172.21.15.110:0/1081701092 conn(0x7f405006d8f0 msgr2=0x7f405006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 -- 172.21.15.110:0/1081701092 shutdown_connections 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.072+0000 7f4057a00640 1 -- 172.21.15.110:0/1081701092 wait complete. 2024-08-17T02:30:03.073 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.073+0000 7f4057a00640 1 Processor -- start 2024-08-17T02:30:03.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.073+0000 7f4057a00640 1 -- start start 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f405015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f405015c600 0x7f405014d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40500ca3f0 con 0x7f405015c230 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405015d360 con 0x7f405015c600 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f4057a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405015d640 con 0x7f40500aa8f0 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.074+0000 7f404fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46020/0 (socket says 172.21.15.110:46020) 2024-08-17T02:30:03.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 -- 172.21.15.110:0/3925000400 learned_addr learned my addr 172.21.15.110:0/3925000400 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:03.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f4055000640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f405015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f4055a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f405015c600 0x7f405014d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 -- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 msgr2=0x7f405015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f405015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 -- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f405015c600 msgr2=0x7f405014d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f405015c600 0x7f405014d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 -- 172.21.15.110:0/3925000400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009450 con 0x7f405015c230 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.075+0000 7f404fe00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b4f0 tx=0x7f403c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.076+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00f510 con 0x7f405015c230 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.076+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f403c00f670 con 0x7f405015c230 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.076+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405015d920 con 0x7f405015c230 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.076+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00fa70 con 0x7f405015c230 2024-08-17T02:30:03.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.076+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405015cfa0 con 0x7f405015c230 2024-08-17T02:30:03.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.077+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405015de20 con 0x7f405015c230 2024-08-17T02:30:03.078 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.078+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f403c01a400 con 0x7f405015c230 2024-08-17T02:30:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.079+0000 7f4043e00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 0x7f4030067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.079 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.079+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f403c081f30 con 0x7f405015c230 2024-08-17T02:30:03.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.079+0000 7f4055000640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 0x7f4030067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.080 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.080+0000 7f4055000640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 0x7f4030067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4044034000 tx=0x7f4044032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.083+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f403c050070 con 0x7f405015c230 2024-08-17T02:30:03.260 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.259+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4050064db0 con 0x7f4030065150 2024-08-17T02:30:03.268 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.267+0000 7f4043e00640 1 -- 172.21.15.110:0/3925000400 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253850 (secure 0 0 0) 0x7f4050064db0 con 0x7f4030065150 2024-08-17T02:30:03.271 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:03.272 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:30:03.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 msgr2=0x7f4030067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 0x7f4030067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4044034000 tx=0x7f4044032000 comp rx=0 tx=0).stop 2024-08-17T02:30:03.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 msgr2=0x7f405014e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f403c00b4f0 tx=0x7f403c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 shutdown_connections 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f4030065150 0x7f4030067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f405015c600 0x7f405014d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f405015c230 0x7f405014e500 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 --2- 172.21.15.110:0/3925000400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40500aa8f0 0x7f405015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 >> 172.21.15.110:0/3925000400 conn(0x7f405006d8f0 msgr2=0x7f405006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.270+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 shutdown_connections 2024-08-17T02:30:03.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.271+0000 7f4057a00640 1 -- 172.21.15.110:0/3925000400 wait complete. 2024-08-17T02:30:03.286 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-08-17T02:30:01.446762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":6,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399240,"kb_used_data":3740,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575480,"statfs":{"total":773094113280,"available":770637291520,"internally_reserved":0,"allocated":3829760,"data_stored":2153731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.746875"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706547+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.699111+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701797+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706718+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:37:46.577204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704171+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:38:41.895748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703508+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:06:35.936942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701738+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.705153+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:39:29.801664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.702579+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:21.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698523+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701212+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:55:21.913817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703243+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:42.644489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703500+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:57.436575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701757+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701233+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704773+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.702806+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704691+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:32.283441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704106+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:12:27.260276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704491+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:21:55.389423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698232+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706519+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:18:46.678605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.704661+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:55.089547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701055+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701388+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.698077+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701219+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.697738+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701234+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:23.792871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.703960+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:46.894627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.701661+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:29:57.695090+0000","last_change":"2024-08-17T02:29:57.695090+0000","last_active":"2024-08-17T02:29:57.695090+0000","last_peered":"2024-08-17T02:29:57.695090+0000","last_clean":"2024-08-17T02:29:57.695090+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:57.695090+0000","last_undegraded":"2024-08-17T02:29:57.695090+0000","last_fullsized":"2024-08-17T02:29:57.695090+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:29:56.688608+0000","last_change":"2024-08-17T02:29:56.706607+0000","last_active":"2024-08-17T02:29:56.688608+0000","last_peered":"2024-08-17T02:29:56.688608+0000","last_clean":"2024-08-17T02:29:56.688608+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:29:56.688608+0000","last_undegraded":"2024-08-17T02:29:56.688608+0000","last_fullsized":"2024-08-17T02:29:56.688608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:41.985183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":168,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-08-17T02:29:52.474845+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:52.474845+0000","last_peered":"2024-08-17T02:29:52.474845+0000","last_clean":"2024-08-17T02:29:52.474845+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:52.474845+0000","last_undegraded":"2024-08-17T02:29:52.474845+0000","last_fullsized":"2024-08-17T02:29:52.474845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":925696,"data_stored":712718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":319488,"data_stored":116545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301840,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070000,"statfs":{"total":96636764160,"available":96327680000,"internally_reserved":0,"allocated":331776,"data_stored":122350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302420,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069420,"statfs":{"total":96636764160,"available":96327086080,"internally_reserved":0,"allocated":925696,"data_stored":712718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:03.290 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:03.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.477+0000 7f11afe00640 1 Processor -- start 2024-08-17T02:30:03.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.477+0000 7f11afe00640 1 -- start start 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11afe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11b0159ca0 0x7f11b00ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b00ccca0 0x7f11b0162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11afe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00cadc0 con 0x7f11b00ca8a0 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11afe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00cd6e0 con 0x7f11b0159ca0 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11afe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00cb060 con 0x7f11b00ccca0 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11aea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11b0159ca0 0x7f11b00ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11aea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11b0159ca0 0x7f11b00ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46028/0 (socket says 172.21.15.110:46028) 2024-08-17T02:30:03.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11aea00640 1 -- 172.21.15.110:0/3771011608 learned_addr learned my addr 172.21.15.110:0/3771011608 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.478+0000 7f11ae000640 1 --1- 172.21.15.110:0/3771011608 >> v1:172.21.15.110:6789/0 conn(0x7f11b00ca8a0 0x7f11b00cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:33286/0 (socket says 172.21.15.110:33286) 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.479+0000 7f11af400640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b00ccca0 0x7f11b0162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.479+0000 7f11aea00640 1 -- 172.21.15.110:0/3771011608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b00ccca0 msgr2=0x7f11b0162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.479+0000 7f11aea00640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b00ccca0 0x7f11b0162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.479+0000 7f11aea00640 1 -- 172.21.15.110:0/3771011608 >> v1:172.21.15.110:6789/0 conn(0x7f11b00ca8a0 legacy=0x7f11b00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.479+0000 7f11aea00640 1 -- 172.21.15.110:0/3771011608 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00cb300 con 0x7f11b0159ca0 2024-08-17T02:30:03.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.480+0000 7f11aea00640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b0159ca0 0x7f11b00ca360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f11b00cd820 tx=0x7f11a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b386716130e42e60 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.480+0000 7f11ad600640 1 -- 172.21.15.110:0/3771011608 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a002ae40 con 0x7f11b0159ca0 2024-08-17T02:30:03.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.480+0000 7f11ad600640 1 -- 172.21.15.110:0/3771011608 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a0032440 con 0x7f11b0159ca0 2024-08-17T02:30:03.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.480+0000 7f11ad600640 1 -- 172.21.15.110:0/3771011608 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0032820 con 0x7f11b0159ca0 2024-08-17T02:30:03.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 -- 172.21.15.110:0/3771011608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b0159ca0 msgr2=0x7f11b00ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b0159ca0 0x7f11b00ca360 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f11b00cd820 tx=0x7f11a00091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 -- 172.21.15.110:0/3771011608 shutdown_connections 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b00ccca0 0x7f11b0162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 --2- 172.21.15.110:0/3771011608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b0159ca0 0x7f11b00ca360 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 -- 172.21.15.110:0/3771011608 >> 172.21.15.110:0/3771011608 conn(0x7f11b0098e00 msgr2=0x7f11b006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 -- 172.21.15.110:0/3771011608 shutdown_connections 2024-08-17T02:30:03.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.481+0000 7f11afe00640 1 -- 172.21.15.110:0/3771011608 wait complete. 2024-08-17T02:30:03.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.482+0000 7f11afe00640 1 Processor -- start 2024-08-17T02:30:03.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.482+0000 7f11afe00640 1 -- start start 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 0x7f11b016c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 0x7f11b00c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c7ac0 con 0x7f11b00ccca0 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00c85f0 con 0x7f11b00ca8a0 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11afe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b016c970 con 0x7f11b0159ca0 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11ae000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11ae000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:46030/0 (socket says 172.21.15.110:46030) 2024-08-17T02:30:03.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.483+0000 7f11ae000640 1 -- 172.21.15.110:0/96809211 learned_addr learned my addr 172.21.15.110:0/96809211 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11af400640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 0x7f11b00c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11aea00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 0x7f11b016c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 -- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 msgr2=0x7f11b00c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 0x7f11b00c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 -- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 msgr2=0x7f11b016c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 0x7f11b016c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 -- 172.21.15.110:0/96809211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009450 con 0x7f11b00ccca0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11af400640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 0x7f11b00c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11aea00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 0x7f11b016c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11ae000640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c4e0 tx=0x7f119c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0072e0 con 0x7f11b00ccca0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c007460 con 0x7f11b00ccca0 2024-08-17T02:30:03.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0047a0 con 0x7f11b00ccca0 2024-08-17T02:30:03.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.484+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b016cc50 con 0x7f11b00ccca0 2024-08-17T02:30:03.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.485+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00c4b20 con 0x7f11b00ccca0 2024-08-17T02:30:03.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.486+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b0071050 con 0x7f11b00ccca0 2024-08-17T02:30:03.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.486+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f119c004bb0 con 0x7f11b00ccca0 2024-08-17T02:30:03.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.487+0000 7f11a6000640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 0x7f1190067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.487+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f119c081d80 con 0x7f11b00ccca0 2024-08-17T02:30:03.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.488+0000 7f11aea00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 0x7f1190067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.488+0000 7f11aea00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 0x7f1190067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f11a0034000 tx=0x7f11a0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.491+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f119c04fda0 con 0x7f11b00ccca0 2024-08-17T02:30:03.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.660+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b0089b20 con 0x7f1190065150 2024-08-17T02:30:03.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.667+0000 7f11a6000640 1 -- 172.21.15.110:0/96809211 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267891 (secure 0 0 0) 0x7f11b0089b20 con 0x7f1190065150 2024-08-17T02:30:03.671 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:03.672 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:30:03.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 msgr2=0x7f1190067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 0x7f1190067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f11a0034000 tx=0x7f11a0032000 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 msgr2=0x7f11b00c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c4e0 tx=0x7f119c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 shutdown_connections 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1190065150 0x7f1190067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11b0159ca0 0x7f11b00c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11b00ccca0 0x7f11b00c7580 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 --2- 172.21.15.110:0/96809211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11b00ca8a0 0x7f11b016c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 >> 172.21.15.110:0/96809211 conn(0x7f11b0098e00 msgr2=0x7f11b0158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 shutdown_connections 2024-08-17T02:30:03.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.671+0000 7f11afe00640 1 -- 172.21.15.110:0/96809211 wait complete. 2024-08-17T02:30:03.686 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:30:03.447064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399636,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575084,"statfs":{"total":773094113280,"available":770636886016,"internally_reserved":0,"allocated":4202496,"data_stored":2318660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000891"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749314+0000","last_change":"2024-08-17T02:29:58.741643+0000","last_active":"2024-08-17T02:29:58.749314+0000","last_peered":"2024-08-17T02:29:58.749314+0000","last_clean":"2024-08-17T02:29:58.749314+0000","last_became_active":"2024-08-17T02:29:58.739611+0000","last_became_peered":"2024-08-17T02:29:58.739611+0000","last_unstale":"2024-08-17T02:29:58.749314+0000","last_undegraded":"2024-08-17T02:29:58.749314+0000","last_fullsized":"2024-08-17T02:29:58.749314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746988+0000","last_change":"2024-08-17T02:29:58.743692+0000","last_active":"2024-08-17T02:29:58.746988+0000","last_peered":"2024-08-17T02:29:58.746988+0000","last_clean":"2024-08-17T02:29:58.746988+0000","last_became_active":"2024-08-17T02:29:58.741923+0000","last_became_peered":"2024-08-17T02:29:58.741923+0000","last_unstale":"2024-08-17T02:29:58.746988+0000","last_undegraded":"2024-08-17T02:29:58.746988+0000","last_fullsized":"2024-08-17T02:29:58.746988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750639+0000","last_change":"2024-08-17T02:29:58.743429+0000","last_active":"2024-08-17T02:29:58.750639+0000","last_peered":"2024-08-17T02:29:58.750639+0000","last_clean":"2024-08-17T02:29:58.750639+0000","last_became_active":"2024-08-17T02:29:58.742398+0000","last_became_peered":"2024-08-17T02:29:58.742398+0000","last_unstale":"2024-08-17T02:29:58.750639+0000","last_undegraded":"2024-08-17T02:29:58.750639+0000","last_fullsized":"2024-08-17T02:29:58.750639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742741+0000","last_change":"2024-08-17T02:29:58.731783+0000","last_active":"2024-08-17T02:29:58.742741+0000","last_peered":"2024-08-17T02:29:58.742741+0000","last_clean":"2024-08-17T02:29:58.742741+0000","last_became_active":"2024-08-17T02:29:58.731530+0000","last_became_peered":"2024-08-17T02:29:58.731530+0000","last_unstale":"2024-08-17T02:29:58.742741+0000","last_undegraded":"2024-08-17T02:29:58.742741+0000","last_fullsized":"2024-08-17T02:29:58.742741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.730477+0000","last_change":"2024-08-17T02:29:58.722268+0000","last_active":"2024-08-17T02:29:58.730477+0000","last_peered":"2024-08-17T02:29:58.730477+0000","last_clean":"2024-08-17T02:29:58.730477+0000","last_became_active":"2024-08-17T02:29:58.721951+0000","last_became_peered":"2024-08-17T02:29:58.721951+0000","last_unstale":"2024-08-17T02:29:58.730477+0000","last_undegraded":"2024-08-17T02:29:58.730477+0000","last_fullsized":"2024-08-17T02:29:58.730477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:24.799353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741898+0000","last_change":"2024-08-17T02:29:58.736216+0000","last_active":"2024-08-17T02:29:58.741898+0000","last_peered":"2024-08-17T02:29:58.741898+0000","last_clean":"2024-08-17T02:29:58.741898+0000","last_became_active":"2024-08-17T02:29:58.735535+0000","last_became_peered":"2024-08-17T02:29:58.735535+0000","last_unstale":"2024-08-17T02:29:58.741898+0000","last_undegraded":"2024-08-17T02:29:58.741898+0000","last_fullsized":"2024-08-17T02:29:58.741898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748584+0000","last_change":"2024-08-17T02:29:58.744028+0000","last_active":"2024-08-17T02:29:58.748584+0000","last_peered":"2024-08-17T02:29:58.748584+0000","last_clean":"2024-08-17T02:29:58.748584+0000","last_became_active":"2024-08-17T02:29:58.743403+0000","last_became_peered":"2024-08-17T02:29:58.743403+0000","last_unstale":"2024-08-17T02:29:58.748584+0000","last_undegraded":"2024-08-17T02:29:58.748584+0000","last_fullsized":"2024-08-17T02:29:58.748584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746871+0000","last_change":"2024-08-17T02:29:58.743182+0000","last_active":"2024-08-17T02:29:58.746871+0000","last_peered":"2024-08-17T02:29:58.746871+0000","last_clean":"2024-08-17T02:29:58.746871+0000","last_became_active":"2024-08-17T02:29:58.742111+0000","last_became_peered":"2024-08-17T02:29:58.742111+0000","last_unstale":"2024-08-17T02:29:58.746871+0000","last_undegraded":"2024-08-17T02:29:58.746871+0000","last_fullsized":"2024-08-17T02:29:58.746871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739442+0000","last_change":"2024-08-17T02:29:58.730907+0000","last_active":"2024-08-17T02:29:58.739442+0000","last_peered":"2024-08-17T02:29:58.739442+0000","last_clean":"2024-08-17T02:29:58.739442+0000","last_became_active":"2024-08-17T02:29:58.727907+0000","last_became_peered":"2024-08-17T02:29:58.727907+0000","last_unstale":"2024-08-17T02:29:58.739442+0000","last_undegraded":"2024-08-17T02:29:58.739442+0000","last_fullsized":"2024-08-17T02:29:58.739442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:53:41.162732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740076+0000","last_change":"2024-08-17T02:29:58.727278+0000","last_active":"2024-08-17T02:29:58.740076+0000","last_peered":"2024-08-17T02:29:58.740076+0000","last_clean":"2024-08-17T02:29:58.740076+0000","last_became_active":"2024-08-17T02:29:58.726951+0000","last_became_peered":"2024-08-17T02:29:58.726951+0000","last_unstale":"2024-08-17T02:29:58.740076+0000","last_undegraded":"2024-08-17T02:29:58.740076+0000","last_fullsized":"2024-08-17T02:29:58.740076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745305+0000","last_change":"2024-08-17T02:29:58.742574+0000","last_active":"2024-08-17T02:29:58.745305+0000","last_peered":"2024-08-17T02:29:58.745305+0000","last_clean":"2024-08-17T02:29:58.745305+0000","last_became_active":"2024-08-17T02:29:58.742198+0000","last_became_peered":"2024-08-17T02:29:58.742198+0000","last_unstale":"2024-08-17T02:29:58.745305+0000","last_undegraded":"2024-08-17T02:29:58.745305+0000","last_fullsized":"2024-08-17T02:29:58.745305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743782+0000","last_change":"2024-08-17T02:29:58.740386+0000","last_active":"2024-08-17T02:29:58.743782+0000","last_peered":"2024-08-17T02:29:58.743782+0000","last_clean":"2024-08-17T02:29:58.743782+0000","last_became_active":"2024-08-17T02:29:58.740099+0000","last_became_peered":"2024-08-17T02:29:58.740099+0000","last_unstale":"2024-08-17T02:29:58.743782+0000","last_undegraded":"2024-08-17T02:29:58.743782+0000","last_fullsized":"2024-08-17T02:29:58.743782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732844+0000","last_change":"2024-08-17T02:29:58.724858+0000","last_active":"2024-08-17T02:29:58.732844+0000","last_peered":"2024-08-17T02:29:58.732844+0000","last_clean":"2024-08-17T02:29:58.732844+0000","last_became_active":"2024-08-17T02:29:58.724544+0000","last_became_peered":"2024-08-17T02:29:58.724544+0000","last_unstale":"2024-08-17T02:29:58.732844+0000","last_undegraded":"2024-08-17T02:29:58.732844+0000","last_fullsized":"2024-08-17T02:29:58.732844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:42.188722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746925+0000","last_change":"2024-08-17T02:29:58.742560+0000","last_active":"2024-08-17T02:29:58.746925+0000","last_peered":"2024-08-17T02:29:58.746925+0000","last_clean":"2024-08-17T02:29:58.746925+0000","last_became_active":"2024-08-17T02:29:58.742283+0000","last_became_peered":"2024-08-17T02:29:58.742283+0000","last_unstale":"2024-08-17T02:29:58.746925+0000","last_undegraded":"2024-08-17T02:29:58.746925+0000","last_fullsized":"2024-08-17T02:29:58.746925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753162+0000","last_change":"2024-08-17T02:29:58.751517+0000","last_active":"2024-08-17T02:29:58.753162+0000","last_peered":"2024-08-17T02:29:58.753162+0000","last_clean":"2024-08-17T02:29:58.753162+0000","last_became_active":"2024-08-17T02:29:58.750958+0000","last_became_peered":"2024-08-17T02:29:58.750958+0000","last_unstale":"2024-08-17T02:29:58.753162+0000","last_undegraded":"2024-08-17T02:29:58.753162+0000","last_fullsized":"2024-08-17T02:29:58.753162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746926+0000","last_change":"2024-08-17T02:29:58.743516+0000","last_active":"2024-08-17T02:29:58.746926+0000","last_peered":"2024-08-17T02:29:58.746926+0000","last_clean":"2024-08-17T02:29:58.746926+0000","last_became_active":"2024-08-17T02:29:58.742817+0000","last_became_peered":"2024-08-17T02:29:58.742817+0000","last_unstale":"2024-08-17T02:29:58.746926+0000","last_undegraded":"2024-08-17T02:29:58.746926+0000","last_fullsized":"2024-08-17T02:29:58.746926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751410+0000","last_change":"2024-08-17T02:29:58.748884+0000","last_active":"2024-08-17T02:29:58.751410+0000","last_peered":"2024-08-17T02:29:58.751410+0000","last_clean":"2024-08-17T02:29:58.751410+0000","last_became_active":"2024-08-17T02:29:58.746711+0000","last_became_peered":"2024-08-17T02:29:58.746711+0000","last_unstale":"2024-08-17T02:29:58.751410+0000","last_undegraded":"2024-08-17T02:29:58.751410+0000","last_fullsized":"2024-08-17T02:29:58.751410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738331+0000","last_change":"2024-08-17T02:29:58.730041+0000","last_active":"2024-08-17T02:29:58.738331+0000","last_peered":"2024-08-17T02:29:58.738331+0000","last_clean":"2024-08-17T02:29:58.738331+0000","last_became_active":"2024-08-17T02:29:58.729760+0000","last_became_peered":"2024-08-17T02:29:58.729760+0000","last_unstale":"2024-08-17T02:29:58.738331+0000","last_undegraded":"2024-08-17T02:29:58.738331+0000","last_fullsized":"2024-08-17T02:29:58.738331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:40.726566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744180+0000","last_change":"2024-08-17T02:29:58.741199+0000","last_active":"2024-08-17T02:29:58.744180+0000","last_peered":"2024-08-17T02:29:58.744180+0000","last_clean":"2024-08-17T02:29:58.744180+0000","last_became_active":"2024-08-17T02:29:58.740700+0000","last_became_peered":"2024-08-17T02:29:58.740700+0000","last_unstale":"2024-08-17T02:29:58.744180+0000","last_undegraded":"2024-08-17T02:29:58.744180+0000","last_fullsized":"2024-08-17T02:29:58.744180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739703+0000","last_change":"2024-08-17T02:29:58.736003+0000","last_active":"2024-08-17T02:29:58.739703+0000","last_peered":"2024-08-17T02:29:58.739703+0000","last_clean":"2024-08-17T02:29:58.739703+0000","last_became_active":"2024-08-17T02:29:58.735774+0000","last_became_peered":"2024-08-17T02:29:58.735774+0000","last_unstale":"2024-08-17T02:29:58.739703+0000","last_undegraded":"2024-08-17T02:29:58.739703+0000","last_fullsized":"2024-08-17T02:29:58.739703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.731002+0000","last_change":"2024-08-17T02:29:58.723426+0000","last_active":"2024-08-17T02:29:58.731002+0000","last_peered":"2024-08-17T02:29:58.731002+0000","last_clean":"2024-08-17T02:29:58.731002+0000","last_became_active":"2024-08-17T02:29:58.723149+0000","last_became_peered":"2024-08-17T02:29:58.723149+0000","last_unstale":"2024-08-17T02:29:58.731002+0000","last_undegraded":"2024-08-17T02:29:58.731002+0000","last_fullsized":"2024-08-17T02:29:58.731002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:10.591085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751621+0000","last_change":"2024-08-17T02:29:58.744330+0000","last_active":"2024-08-17T02:29:58.751621+0000","last_peered":"2024-08-17T02:29:58.751621+0000","last_clean":"2024-08-17T02:29:58.751621+0000","last_became_active":"2024-08-17T02:29:58.744077+0000","last_became_peered":"2024-08-17T02:29:58.744077+0000","last_unstale":"2024-08-17T02:29:58.751621+0000","last_undegraded":"2024-08-17T02:29:58.751621+0000","last_fullsized":"2024-08-17T02:29:58.751621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:14.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747028+0000","last_change":"2024-08-17T02:29:58.744955+0000","last_active":"2024-08-17T02:29:58.747028+0000","last_peered":"2024-08-17T02:29:58.747028+0000","last_clean":"2024-08-17T02:29:58.747028+0000","last_became_active":"2024-08-17T02:29:58.744686+0000","last_became_peered":"2024-08-17T02:29:58.744686+0000","last_unstale":"2024-08-17T02:29:58.747028+0000","last_undegraded":"2024-08-17T02:29:58.747028+0000","last_fullsized":"2024-08-17T02:29:58.747028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:53.311811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742076+0000","last_change":"2024-08-17T02:29:58.737198+0000","last_active":"2024-08-17T02:29:58.742076+0000","last_peered":"2024-08-17T02:29:58.742076+0000","last_clean":"2024-08-17T02:29:58.742076+0000","last_became_active":"2024-08-17T02:29:58.736888+0000","last_became_peered":"2024-08-17T02:29:58.736888+0000","last_unstale":"2024-08-17T02:29:58.742076+0000","last_undegraded":"2024-08-17T02:29:58.742076+0000","last_fullsized":"2024-08-17T02:29:58.742076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743098+0000","last_change":"2024-08-17T02:29:58.734524+0000","last_active":"2024-08-17T02:29:58.743098+0000","last_peered":"2024-08-17T02:29:58.743098+0000","last_clean":"2024-08-17T02:29:58.743098+0000","last_became_active":"2024-08-17T02:29:58.734301+0000","last_became_peered":"2024-08-17T02:29:58.734301+0000","last_unstale":"2024-08-17T02:29:58.743098+0000","last_undegraded":"2024-08-17T02:29:58.743098+0000","last_fullsized":"2024-08-17T02:29:58.743098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:04.992743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741696+0000","last_change":"2024-08-17T02:29:58.740075+0000","last_active":"2024-08-17T02:29:58.741696+0000","last_peered":"2024-08-17T02:29:58.741696+0000","last_clean":"2024-08-17T02:29:58.741696+0000","last_became_active":"2024-08-17T02:29:58.738155+0000","last_became_peered":"2024-08-17T02:29:58.738155+0000","last_unstale":"2024-08-17T02:29:58.741696+0000","last_undegraded":"2024-08-17T02:29:58.741696+0000","last_fullsized":"2024-08-17T02:29:58.741696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:30.461064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743326+0000","last_change":"2024-08-17T02:29:58.733055+0000","last_active":"2024-08-17T02:29:58.743326+0000","last_peered":"2024-08-17T02:29:58.743326+0000","last_clean":"2024-08-17T02:29:58.743326+0000","last_became_active":"2024-08-17T02:29:58.732825+0000","last_became_peered":"2024-08-17T02:29:58.732825+0000","last_unstale":"2024-08-17T02:29:58.743326+0000","last_undegraded":"2024-08-17T02:29:58.743326+0000","last_fullsized":"2024-08-17T02:29:58.743326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749674+0000","last_change":"2024-08-17T02:29:58.745816+0000","last_active":"2024-08-17T02:29:58.749674+0000","last_peered":"2024-08-17T02:29:58.749674+0000","last_clean":"2024-08-17T02:29:58.749674+0000","last_became_active":"2024-08-17T02:29:58.745577+0000","last_became_peered":"2024-08-17T02:29:58.745577+0000","last_unstale":"2024-08-17T02:29:58.749674+0000","last_undegraded":"2024-08-17T02:29:58.749674+0000","last_fullsized":"2024-08-17T02:29:58.749674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751986+0000","last_change":"2024-08-17T02:29:58.749463+0000","last_active":"2024-08-17T02:29:58.751986+0000","last_peered":"2024-08-17T02:29:58.751986+0000","last_clean":"2024-08-17T02:29:58.751986+0000","last_became_active":"2024-08-17T02:29:58.747016+0000","last_became_peered":"2024-08-17T02:29:58.747016+0000","last_unstale":"2024-08-17T02:29:58.751986+0000","last_undegraded":"2024-08-17T02:29:58.751986+0000","last_fullsized":"2024-08-17T02:29:58.751986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:47.734268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749971+0000","last_change":"2024-08-17T02:29:58.746539+0000","last_active":"2024-08-17T02:29:58.749971+0000","last_peered":"2024-08-17T02:29:58.749971+0000","last_clean":"2024-08-17T02:29:58.749971+0000","last_became_active":"2024-08-17T02:29:58.746229+0000","last_became_peered":"2024-08-17T02:29:58.746229+0000","last_unstale":"2024-08-17T02:29:58.749971+0000","last_undegraded":"2024-08-17T02:29:58.749971+0000","last_fullsized":"2024-08-17T02:29:58.749971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749209+0000","last_change":"2024-08-17T02:29:58.741822+0000","last_active":"2024-08-17T02:29:58.749209+0000","last_peered":"2024-08-17T02:29:58.749209+0000","last_clean":"2024-08-17T02:29:58.749209+0000","last_became_active":"2024-08-17T02:29:58.741389+0000","last_became_peered":"2024-08-17T02:29:58.741389+0000","last_unstale":"2024-08-17T02:29:58.749209+0000","last_undegraded":"2024-08-17T02:29:58.749209+0000","last_fullsized":"2024-08-17T02:29:58.749209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744371+0000","last_change":"2024-08-17T02:29:58.738700+0000","last_active":"2024-08-17T02:29:58.744371+0000","last_peered":"2024-08-17T02:29:58.744371+0000","last_clean":"2024-08-17T02:29:58.744371+0000","last_became_active":"2024-08-17T02:29:58.738357+0000","last_became_peered":"2024-08-17T02:29:58.738357+0000","last_unstale":"2024-08-17T02:29:58.744371+0000","last_undegraded":"2024-08-17T02:29:58.744371+0000","last_fullsized":"2024-08-17T02:29:58.744371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745622+0000","last_change":"2024-08-17T02:29:58.742020+0000","last_active":"2024-08-17T02:29:58.745622+0000","last_peered":"2024-08-17T02:29:58.745622+0000","last_clean":"2024-08-17T02:29:58.745622+0000","last_became_active":"2024-08-17T02:29:58.741761+0000","last_became_peered":"2024-08-17T02:29:58.741761+0000","last_unstale":"2024-08-17T02:29:58.745622+0000","last_undegraded":"2024-08-17T02:29:58.745622+0000","last_fullsized":"2024-08-17T02:29:58.745622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:57.027420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752498+0000","last_change":"2024-08-17T02:29:57.725268+0000","last_active":"2024-08-17T02:29:58.752498+0000","last_peered":"2024-08-17T02:29:58.752498+0000","last_clean":"2024-08-17T02:29:58.752498+0000","last_became_active":"2024-08-17T02:29:57.724838+0000","last_became_peered":"2024-08-17T02:29:57.724838+0000","last_unstale":"2024-08-17T02:29:58.752498+0000","last_undegraded":"2024-08-17T02:29:58.752498+0000","last_fullsized":"2024-08-17T02:29:58.752498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749334+0000","last_change":"2024-08-17T02:29:58.742048+0000","last_active":"2024-08-17T02:29:58.749334+0000","last_peered":"2024-08-17T02:29:58.749334+0000","last_clean":"2024-08-17T02:29:58.749334+0000","last_became_active":"2024-08-17T02:29:58.741776+0000","last_became_peered":"2024-08-17T02:29:58.741776+0000","last_unstale":"2024-08-17T02:29:58.749334+0000","last_undegraded":"2024-08-17T02:29:58.749334+0000","last_fullsized":"2024-08-17T02:29:58.749334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:11.094720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749909+0000","last_change":"2024-08-17T02:29:57.728560+0000","last_active":"2024-08-17T02:29:58.749909+0000","last_peered":"2024-08-17T02:29:58.749909+0000","last_clean":"2024-08-17T02:29:58.749909+0000","last_became_active":"2024-08-17T02:29:57.728348+0000","last_became_peered":"2024-08-17T02:29:57.728348+0000","last_unstale":"2024-08-17T02:29:58.749909+0000","last_undegraded":"2024-08-17T02:29:58.749909+0000","last_fullsized":"2024-08-17T02:29:58.749909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751734+0000","last_change":"2024-08-17T02:29:58.747628+0000","last_active":"2024-08-17T02:29:58.751734+0000","last_peered":"2024-08-17T02:29:58.751734+0000","last_clean":"2024-08-17T02:29:58.751734+0000","last_became_active":"2024-08-17T02:29:58.747337+0000","last_became_peered":"2024-08-17T02:29:58.747337+0000","last_unstale":"2024-08-17T02:29:58.751734+0000","last_undegraded":"2024-08-17T02:29:58.751734+0000","last_fullsized":"2024-08-17T02:29:58.751734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:14.428939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748007+0000","last_change":"2024-08-17T02:29:57.717746+0000","last_active":"2024-08-17T02:29:58.748007+0000","last_peered":"2024-08-17T02:29:58.748007+0000","last_clean":"2024-08-17T02:29:58.748007+0000","last_became_active":"2024-08-17T02:29:57.717222+0000","last_became_peered":"2024-08-17T02:29:57.717222+0000","last_unstale":"2024-08-17T02:29:58.748007+0000","last_undegraded":"2024-08-17T02:29:58.748007+0000","last_fullsized":"2024-08-17T02:29:58.748007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:25.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:58.730890+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:58.730471+0000","last_became_peered":"2024-08-17T02:29:58.730471+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:10.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746151+0000","last_change":"2024-08-17T02:29:57.725880+0000","last_active":"2024-08-17T02:29:58.746151+0000","last_peered":"2024-08-17T02:29:58.746151+0000","last_clean":"2024-08-17T02:29:58.746151+0000","last_became_active":"2024-08-17T02:29:57.725454+0000","last_became_peered":"2024-08-17T02:29:57.725454+0000","last_unstale":"2024-08-17T02:29:58.746151+0000","last_undegraded":"2024-08-17T02:29:58.746151+0000","last_fullsized":"2024-08-17T02:29:58.746151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:56.890041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745195+0000","last_change":"2024-08-17T02:29:58.741751+0000","last_active":"2024-08-17T02:29:58.745195+0000","last_peered":"2024-08-17T02:29:58.745195+0000","last_clean":"2024-08-17T02:29:58.745195+0000","last_became_active":"2024-08-17T02:29:58.741574+0000","last_became_peered":"2024-08-17T02:29:58.741574+0000","last_unstale":"2024-08-17T02:29:58.745195+0000","last_undegraded":"2024-08-17T02:29:58.745195+0000","last_fullsized":"2024-08-17T02:29:58.745195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745104+0000","last_change":"2024-08-17T02:29:57.719062+0000","last_active":"2024-08-17T02:29:58.745104+0000","last_peered":"2024-08-17T02:29:58.745104+0000","last_clean":"2024-08-17T02:29:58.745104+0000","last_became_active":"2024-08-17T02:29:57.716423+0000","last_became_peered":"2024-08-17T02:29:57.716423+0000","last_unstale":"2024-08-17T02:29:58.745104+0000","last_undegraded":"2024-08-17T02:29:58.745104+0000","last_fullsized":"2024-08-17T02:29:58.745104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:52.826206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749705+0000","last_change":"2024-08-17T02:29:58.747561+0000","last_active":"2024-08-17T02:29:58.749705+0000","last_peered":"2024-08-17T02:29:58.749705+0000","last_clean":"2024-08-17T02:29:58.749705+0000","last_became_active":"2024-08-17T02:29:58.747006+0000","last_became_peered":"2024-08-17T02:29:58.747006+0000","last_unstale":"2024-08-17T02:29:58.749705+0000","last_undegraded":"2024-08-17T02:29:58.749705+0000","last_fullsized":"2024-08-17T02:29:58.749705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743728+0000","last_change":"2024-08-17T02:29:57.716703+0000","last_active":"2024-08-17T02:29:58.743728+0000","last_peered":"2024-08-17T02:29:58.743728+0000","last_clean":"2024-08-17T02:29:58.743728+0000","last_became_active":"2024-08-17T02:29:57.716398+0000","last_became_peered":"2024-08-17T02:29:57.716398+0000","last_unstale":"2024-08-17T02:29:58.743728+0000","last_undegraded":"2024-08-17T02:29:58.743728+0000","last_fullsized":"2024-08-17T02:29:58.743728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:05:11.190397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741009+0000","last_change":"2024-08-17T02:29:58.736558+0000","last_active":"2024-08-17T02:29:58.741009+0000","last_peered":"2024-08-17T02:29:58.741009+0000","last_clean":"2024-08-17T02:29:58.741009+0000","last_became_active":"2024-08-17T02:29:58.735265+0000","last_became_peered":"2024-08-17T02:29:58.735265+0000","last_unstale":"2024-08-17T02:29:58.741009+0000","last_undegraded":"2024-08-17T02:29:58.741009+0000","last_fullsized":"2024-08-17T02:29:58.741009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:35.180625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717776+0000","last_change":"2024-08-17T02:29:57.717409+0000","last_active":"2024-08-17T02:29:58.717776+0000","last_peered":"2024-08-17T02:29:58.717776+0000","last_clean":"2024-08-17T02:29:58.717776+0000","last_became_active":"2024-08-17T02:29:57.717050+0000","last_became_peered":"2024-08-17T02:29:57.717050+0000","last_unstale":"2024-08-17T02:29:58.717776+0000","last_undegraded":"2024-08-17T02:29:58.717776+0000","last_fullsized":"2024-08-17T02:29:58.717776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:56.020938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740003+0000","last_change":"2024-08-17T02:29:58.728203+0000","last_active":"2024-08-17T02:29:58.740003+0000","last_peered":"2024-08-17T02:29:58.740003+0000","last_clean":"2024-08-17T02:29:58.740003+0000","last_became_active":"2024-08-17T02:29:58.727970+0000","last_became_peered":"2024-08-17T02:29:58.727970+0000","last_unstale":"2024-08-17T02:29:58.740003+0000","last_undegraded":"2024-08-17T02:29:58.740003+0000","last_fullsized":"2024-08-17T02:29:58.740003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:48.051059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.720768+0000","last_change":"2024-08-17T02:29:57.712754+0000","last_active":"2024-08-17T02:29:58.720768+0000","last_peered":"2024-08-17T02:29:58.720768+0000","last_clean":"2024-08-17T02:29:58.720768+0000","last_became_active":"2024-08-17T02:29:57.712420+0000","last_became_peered":"2024-08-17T02:29:57.712420+0000","last_unstale":"2024-08-17T02:29:58.720768+0000","last_undegraded":"2024-08-17T02:29:58.720768+0000","last_fullsized":"2024-08-17T02:29:58.720768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:52.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743754+0000","last_change":"2024-08-17T02:29:58.741449+0000","last_active":"2024-08-17T02:29:58.743754+0000","last_peered":"2024-08-17T02:29:58.743754+0000","last_clean":"2024-08-17T02:29:58.743754+0000","last_became_active":"2024-08-17T02:29:58.741064+0000","last_became_peered":"2024-08-17T02:29:58.741064+0000","last_unstale":"2024-08-17T02:29:58.743754+0000","last_undegraded":"2024-08-17T02:29:58.743754+0000","last_fullsized":"2024-08-17T02:29:58.743754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721533+0000","last_change":"2024-08-17T02:29:57.728908+0000","last_active":"2024-08-17T02:29:58.721533+0000","last_peered":"2024-08-17T02:29:58.721533+0000","last_clean":"2024-08-17T02:29:58.721533+0000","last_became_active":"2024-08-17T02:29:57.728140+0000","last_became_peered":"2024-08-17T02:29:57.728140+0000","last_unstale":"2024-08-17T02:29:58.721533+0000","last_undegraded":"2024-08-17T02:29:58.721533+0000","last_fullsized":"2024-08-17T02:29:58.721533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:52.305329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748869+0000","last_change":"2024-08-17T02:29:58.747780+0000","last_active":"2024-08-17T02:29:58.748869+0000","last_peered":"2024-08-17T02:29:58.748869+0000","last_clean":"2024-08-17T02:29:58.748869+0000","last_became_active":"2024-08-17T02:29:58.747610+0000","last_became_peered":"2024-08-17T02:29:58.747610+0000","last_unstale":"2024-08-17T02:29:58.748869+0000","last_undegraded":"2024-08-17T02:29:58.748869+0000","last_fullsized":"2024-08-17T02:29:58.748869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:58.341084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.723686+0000","last_change":"2024-08-17T02:29:57.716795+0000","last_active":"2024-08-17T02:29:58.723686+0000","last_peered":"2024-08-17T02:29:58.723686+0000","last_clean":"2024-08-17T02:29:58.723686+0000","last_became_active":"2024-08-17T02:29:57.716450+0000","last_became_peered":"2024-08-17T02:29:57.716450+0000","last_unstale":"2024-08-17T02:29:58.723686+0000","last_undegraded":"2024-08-17T02:29:58.723686+0000","last_fullsized":"2024-08-17T02:29:58.723686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740858+0000","last_change":"2024-08-17T02:29:58.739170+0000","last_active":"2024-08-17T02:29:58.740858+0000","last_peered":"2024-08-17T02:29:58.740858+0000","last_clean":"2024-08-17T02:29:58.740858+0000","last_became_active":"2024-08-17T02:29:58.738402+0000","last_became_peered":"2024-08-17T02:29:58.738402+0000","last_unstale":"2024-08-17T02:29:58.740858+0000","last_undegraded":"2024-08-17T02:29:58.740858+0000","last_fullsized":"2024-08-17T02:29:58.740858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:00.940495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:57.728489+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:57.728142+0000","last_became_peered":"2024-08-17T02:29:57.728142+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750659+0000","last_change":"2024-08-17T02:29:58.743587+0000","last_active":"2024-08-17T02:29:58.750659+0000","last_peered":"2024-08-17T02:29:58.750659+0000","last_clean":"2024-08-17T02:29:58.750659+0000","last_became_active":"2024-08-17T02:29:58.742775+0000","last_became_peered":"2024-08-17T02:29:58.742775+0000","last_unstale":"2024-08-17T02:29:58.750659+0000","last_undegraded":"2024-08-17T02:29:58.750659+0000","last_fullsized":"2024-08-17T02:29:58.750659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753775+0000","last_change":"2024-08-17T02:29:57.721570+0000","last_active":"2024-08-17T02:29:58.753775+0000","last_peered":"2024-08-17T02:29:58.753775+0000","last_clean":"2024-08-17T02:29:58.753775+0000","last_became_active":"2024-08-17T02:29:57.721294+0000","last_became_peered":"2024-08-17T02:29:57.721294+0000","last_unstale":"2024-08-17T02:29:58.753775+0000","last_undegraded":"2024-08-17T02:29:58.753775+0000","last_fullsized":"2024-08-17T02:29:58.753775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:52.103896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743390+0000","last_change":"2024-08-17T02:29:58.735104+0000","last_active":"2024-08-17T02:29:58.743390+0000","last_peered":"2024-08-17T02:29:58.743390+0000","last_clean":"2024-08-17T02:29:58.743390+0000","last_became_active":"2024-08-17T02:29:58.733757+0000","last_became_peered":"2024-08-17T02:29:58.733757+0000","last_unstale":"2024-08-17T02:29:58.743390+0000","last_undegraded":"2024-08-17T02:29:58.743390+0000","last_fullsized":"2024-08-17T02:29:58.743390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:30.822073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750467+0000","last_change":"2024-08-17T02:29:57.719687+0000","last_active":"2024-08-17T02:29:58.750467+0000","last_peered":"2024-08-17T02:29:58.750467+0000","last_clean":"2024-08-17T02:29:58.750467+0000","last_became_active":"2024-08-17T02:29:57.719440+0000","last_became_peered":"2024-08-17T02:29:57.719440+0000","last_unstale":"2024-08-17T02:29:58.750467+0000","last_undegraded":"2024-08-17T02:29:58.750467+0000","last_fullsized":"2024-08-17T02:29:58.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:07.181032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748880+0000","last_change":"2024-08-17T02:29:58.748038+0000","last_active":"2024-08-17T02:29:58.748880+0000","last_peered":"2024-08-17T02:29:58.748880+0000","last_clean":"2024-08-17T02:29:58.748880+0000","last_became_active":"2024-08-17T02:29:58.747877+0000","last_became_peered":"2024-08-17T02:29:58.747877+0000","last_unstale":"2024-08-17T02:29:58.748880+0000","last_undegraded":"2024-08-17T02:29:58.748880+0000","last_fullsized":"2024-08-17T02:29:58.748880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712308+0000","last_change":"2024-08-17T02:29:57.723447+0000","last_active":"2024-08-17T02:29:58.712308+0000","last_peered":"2024-08-17T02:29:58.712308+0000","last_clean":"2024-08-17T02:29:58.712308+0000","last_became_active":"2024-08-17T02:29:57.723180+0000","last_became_peered":"2024-08-17T02:29:57.723180+0000","last_unstale":"2024-08-17T02:29:58.712308+0000","last_undegraded":"2024-08-17T02:29:58.712308+0000","last_fullsized":"2024-08-17T02:29:58.712308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746908+0000","last_change":"2024-08-17T02:29:58.743362+0000","last_active":"2024-08-17T02:29:58.746908+0000","last_peered":"2024-08-17T02:29:58.746908+0000","last_clean":"2024-08-17T02:29:58.746908+0000","last_became_active":"2024-08-17T02:29:58.742468+0000","last_became_peered":"2024-08-17T02:29:58.742468+0000","last_unstale":"2024-08-17T02:29:58.746908+0000","last_undegraded":"2024-08-17T02:29:58.746908+0000","last_fullsized":"2024-08-17T02:29:58.746908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717873+0000","last_change":"2024-08-17T02:29:57.728229+0000","last_active":"2024-08-17T02:29:58.717873+0000","last_peered":"2024-08-17T02:29:58.717873+0000","last_clean":"2024-08-17T02:29:58.717873+0000","last_became_active":"2024-08-17T02:29:57.727932+0000","last_became_peered":"2024-08-17T02:29:57.727932+0000","last_unstale":"2024-08-17T02:29:58.717873+0000","last_undegraded":"2024-08-17T02:29:58.717873+0000","last_fullsized":"2024-08-17T02:29:58.717873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749191+0000","last_change":"2024-08-17T02:29:58.741671+0000","last_active":"2024-08-17T02:29:58.749191+0000","last_peered":"2024-08-17T02:29:58.749191+0000","last_clean":"2024-08-17T02:29:58.749191+0000","last_became_active":"2024-08-17T02:29:58.741045+0000","last_became_peered":"2024-08-17T02:29:58.741045+0000","last_unstale":"2024-08-17T02:29:58.749191+0000","last_undegraded":"2024-08-17T02:29:58.749191+0000","last_fullsized":"2024-08-17T02:29:58.749191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:26.986040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751388+0000","last_change":"2024-08-17T02:29:57.719498+0000","last_active":"2024-08-17T02:29:58.751388+0000","last_peered":"2024-08-17T02:29:58.751388+0000","last_clean":"2024-08-17T02:29:58.751388+0000","last_became_active":"2024-08-17T02:29:57.719204+0000","last_became_peered":"2024-08-17T02:29:57.719204+0000","last_unstale":"2024-08-17T02:29:58.751388+0000","last_undegraded":"2024-08-17T02:29:58.751388+0000","last_fullsized":"2024-08-17T02:29:58.751388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:15.868133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741526+0000","last_change":"2024-08-17T02:29:58.735615+0000","last_active":"2024-08-17T02:29:58.741526+0000","last_peered":"2024-08-17T02:29:58.741526+0000","last_clean":"2024-08-17T02:29:58.741526+0000","last_became_active":"2024-08-17T02:29:58.735282+0000","last_became_peered":"2024-08-17T02:29:58.735282+0000","last_unstale":"2024-08-17T02:29:58.741526+0000","last_undegraded":"2024-08-17T02:29:58.741526+0000","last_fullsized":"2024-08-17T02:29:58.741526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:57.528270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747001+0000","last_change":"2024-08-17T02:29:57.717880+0000","last_active":"2024-08-17T02:29:58.747001+0000","last_peered":"2024-08-17T02:29:58.747001+0000","last_clean":"2024-08-17T02:29:58.747001+0000","last_became_active":"2024-08-17T02:29:57.717512+0000","last_became_peered":"2024-08-17T02:29:57.717512+0000","last_unstale":"2024-08-17T02:29:58.747001+0000","last_undegraded":"2024-08-17T02:29:58.747001+0000","last_fullsized":"2024-08-17T02:29:58.747001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752046+0000","last_change":"2024-08-17T02:29:58.750227+0000","last_active":"2024-08-17T02:29:58.752046+0000","last_peered":"2024-08-17T02:29:58.752046+0000","last_clean":"2024-08-17T02:29:58.752046+0000","last_became_active":"2024-08-17T02:29:58.749963+0000","last_became_peered":"2024-08-17T02:29:58.749963+0000","last_unstale":"2024-08-17T02:29:58.752046+0000","last_undegraded":"2024-08-17T02:29:58.752046+0000","last_fullsized":"2024-08-17T02:29:58.752046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750058+0000","last_change":"2024-08-17T02:29:57.712758+0000","last_active":"2024-08-17T02:29:58.750058+0000","last_peered":"2024-08-17T02:29:58.750058+0000","last_clean":"2024-08-17T02:29:58.750058+0000","last_became_active":"2024-08-17T02:29:57.712427+0000","last_became_peered":"2024-08-17T02:29:57.712427+0000","last_unstale":"2024-08-17T02:29:58.750058+0000","last_undegraded":"2024-08-17T02:29:58.750058+0000","last_fullsized":"2024-08-17T02:29:58.750058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:15.716980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742168+0000","last_change":"2024-08-17T02:29:58.730263+0000","last_active":"2024-08-17T02:29:58.742168+0000","last_peered":"2024-08-17T02:29:58.742168+0000","last_clean":"2024-08-17T02:29:58.742168+0000","last_became_active":"2024-08-17T02:29:58.729958+0000","last_became_peered":"2024-08-17T02:29:58.729958+0000","last_unstale":"2024-08-17T02:29:58.742168+0000","last_undegraded":"2024-08-17T02:29:58.742168+0000","last_fullsized":"2024-08-17T02:29:58.742168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738187+0000","last_change":"2024-08-17T02:29:57.720523+0000","last_active":"2024-08-17T02:29:58.738187+0000","last_peered":"2024-08-17T02:29:58.738187+0000","last_clean":"2024-08-17T02:29:58.738187+0000","last_became_active":"2024-08-17T02:29:57.720285+0000","last_became_peered":"2024-08-17T02:29:57.720285+0000","last_unstale":"2024-08-17T02:29:58.738187+0000","last_undegraded":"2024-08-17T02:29:58.738187+0000","last_fullsized":"2024-08-17T02:29:58.738187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:03.855557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746682+0000","last_change":"2024-08-17T02:29:58.741472+0000","last_active":"2024-08-17T02:29:58.746682+0000","last_peered":"2024-08-17T02:29:58.746682+0000","last_clean":"2024-08-17T02:29:58.746682+0000","last_became_active":"2024-08-17T02:29:58.741210+0000","last_became_peered":"2024-08-17T02:29:58.741210+0000","last_unstale":"2024-08-17T02:29:58.746682+0000","last_undegraded":"2024-08-17T02:29:58.746682+0000","last_fullsized":"2024-08-17T02:29:58.746682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:22.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.725302+0000","last_change":"2024-08-17T02:29:57.717827+0000","last_active":"2024-08-17T02:29:58.725302+0000","last_peered":"2024-08-17T02:29:58.725302+0000","last_clean":"2024-08-17T02:29:58.725302+0000","last_became_active":"2024-08-17T02:29:57.716787+0000","last_became_peered":"2024-08-17T02:29:57.716787+0000","last_unstale":"2024-08-17T02:29:58.725302+0000","last_undegraded":"2024-08-17T02:29:58.725302+0000","last_fullsized":"2024-08-17T02:29:58.725302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:23.126977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.733452+0000","last_change":"2024-08-17T02:29:58.732424+0000","last_active":"2024-08-17T02:29:58.733452+0000","last_peered":"2024-08-17T02:29:58.733452+0000","last_clean":"2024-08-17T02:29:58.733452+0000","last_became_active":"2024-08-17T02:29:58.732155+0000","last_became_peered":"2024-08-17T02:29:58.732155+0000","last_unstale":"2024-08-17T02:29:58.733452+0000","last_undegraded":"2024-08-17T02:29:58.733452+0000","last_fullsized":"2024-08-17T02:29:58.733452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:49.295779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747704+0000","last_change":"2024-08-17T02:29:57.720005+0000","last_active":"2024-08-17T02:29:58.747704+0000","last_peered":"2024-08-17T02:29:58.747704+0000","last_clean":"2024-08-17T02:29:58.747704+0000","last_became_active":"2024-08-17T02:29:57.719755+0000","last_became_peered":"2024-08-17T02:29:57.719755+0000","last_unstale":"2024-08-17T02:29:58.747704+0000","last_undegraded":"2024-08-17T02:29:58.747704+0000","last_fullsized":"2024-08-17T02:29:58.747704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732864+0000","last_change":"2024-08-17T02:29:58.724971+0000","last_active":"2024-08-17T02:29:58.732864+0000","last_peered":"2024-08-17T02:29:58.732864+0000","last_clean":"2024-08-17T02:29:58.732864+0000","last_became_active":"2024-08-17T02:29:58.722256+0000","last_became_peered":"2024-08-17T02:29:58.722256+0000","last_unstale":"2024-08-17T02:29:58.732864+0000","last_undegraded":"2024-08-17T02:29:58.732864+0000","last_fullsized":"2024-08-17T02:29:58.732864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:43.541931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724915+0000","last_change":"2024-08-17T02:29:57.725898+0000","last_active":"2024-08-17T02:29:58.724915+0000","last_peered":"2024-08-17T02:29:58.724915+0000","last_clean":"2024-08-17T02:29:58.724915+0000","last_became_active":"2024-08-17T02:29:57.725628+0000","last_became_peered":"2024-08-17T02:29:57.725628+0000","last_unstale":"2024-08-17T02:29:58.724915+0000","last_undegraded":"2024-08-17T02:29:58.724915+0000","last_fullsized":"2024-08-17T02:29:58.724915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.735480+0000","last_change":"2024-08-17T02:29:58.724432+0000","last_active":"2024-08-17T02:29:58.735480+0000","last_peered":"2024-08-17T02:29:58.735480+0000","last_clean":"2024-08-17T02:29:58.735480+0000","last_became_active":"2024-08-17T02:29:58.724186+0000","last_became_peered":"2024-08-17T02:29:58.724186+0000","last_unstale":"2024-08-17T02:29:58.735480+0000","last_undegraded":"2024-08-17T02:29:58.735480+0000","last_fullsized":"2024-08-17T02:29:58.735480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:34.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721339+0000","last_change":"2024-08-17T02:29:57.717344+0000","last_active":"2024-08-17T02:29:58.721339+0000","last_peered":"2024-08-17T02:29:58.721339+0000","last_clean":"2024-08-17T02:29:58.721339+0000","last_became_active":"2024-08-17T02:29:57.717079+0000","last_became_peered":"2024-08-17T02:29:57.717079+0000","last_unstale":"2024-08-17T02:29:58.721339+0000","last_undegraded":"2024-08-17T02:29:58.721339+0000","last_fullsized":"2024-08-17T02:29:58.721339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:45.092703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748608+0000","last_change":"2024-08-17T02:29:58.744207+0000","last_active":"2024-08-17T02:29:58.748608+0000","last_peered":"2024-08-17T02:29:58.748608+0000","last_clean":"2024-08-17T02:29:58.748608+0000","last_became_active":"2024-08-17T02:29:58.743759+0000","last_became_peered":"2024-08-17T02:29:58.743759+0000","last_unstale":"2024-08-17T02:29:58.748608+0000","last_undegraded":"2024-08-17T02:29:58.748608+0000","last_fullsized":"2024-08-17T02:29:58.748608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.726918+0000","last_change":"2024-08-17T02:29:57.730963+0000","last_active":"2024-08-17T02:29:58.726918+0000","last_peered":"2024-08-17T02:29:58.726918+0000","last_clean":"2024-08-17T02:29:58.726918+0000","last_became_active":"2024-08-17T02:29:57.730724+0000","last_became_peered":"2024-08-17T02:29:57.730724+0000","last_unstale":"2024-08-17T02:29:58.726918+0000","last_undegraded":"2024-08-17T02:29:58.726918+0000","last_fullsized":"2024-08-17T02:29:58.726918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:42.644489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739575+0000","last_change":"2024-08-17T02:29:58.737024+0000","last_active":"2024-08-17T02:29:58.739575+0000","last_peered":"2024-08-17T02:29:58.739575+0000","last_clean":"2024-08-17T02:29:58.739575+0000","last_became_active":"2024-08-17T02:29:58.736783+0000","last_became_peered":"2024-08-17T02:29:58.736783+0000","last_unstale":"2024-08-17T02:29:58.739575+0000","last_undegraded":"2024-08-17T02:29:58.739575+0000","last_fullsized":"2024-08-17T02:29:58.739575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:32.640928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751449+0000","last_change":"2024-08-17T02:29:57.721050+0000","last_active":"2024-08-17T02:29:58.751449+0000","last_peered":"2024-08-17T02:29:58.751449+0000","last_clean":"2024-08-17T02:29:58.751449+0000","last_became_active":"2024-08-17T02:29:57.720746+0000","last_became_peered":"2024-08-17T02:29:57.720746+0000","last_unstale":"2024-08-17T02:29:58.751449+0000","last_undegraded":"2024-08-17T02:29:58.751449+0000","last_fullsized":"2024-08-17T02:29:58.751449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752028+0000","last_change":"2024-08-17T02:29:58.750144+0000","last_active":"2024-08-17T02:29:58.752028+0000","last_peered":"2024-08-17T02:29:58.752028+0000","last_clean":"2024-08-17T02:29:58.752028+0000","last_became_active":"2024-08-17T02:29:58.749895+0000","last_became_peered":"2024-08-17T02:29:58.749895+0000","last_unstale":"2024-08-17T02:29:58.752028+0000","last_undegraded":"2024-08-17T02:29:58.752028+0000","last_fullsized":"2024-08-17T02:29:58.752028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:30:00.074040+0000","last_change":"2024-08-17T02:29:57.723014+0000","last_active":"2024-08-17T02:30:00.074040+0000","last_peered":"2024-08-17T02:30:00.074040+0000","last_clean":"2024-08-17T02:30:00.074040+0000","last_became_active":"2024-08-17T02:29:57.722592+0000","last_became_peered":"2024-08-17T02:29:57.722592+0000","last_unstale":"2024-08-17T02:30:00.074040+0000","last_undegraded":"2024-08-17T02:30:00.074040+0000","last_fullsized":"2024-08-17T02:30:00.074040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745746+0000","last_change":"2024-08-17T02:29:58.733329+0000","last_active":"2024-08-17T02:29:58.745746+0000","last_peered":"2024-08-17T02:29:58.745746+0000","last_clean":"2024-08-17T02:29:58.745746+0000","last_became_active":"2024-08-17T02:29:58.733024+0000","last_became_peered":"2024-08-17T02:29:58.733024+0000","last_unstale":"2024-08-17T02:29:58.745746+0000","last_undegraded":"2024-08-17T02:29:58.745746+0000","last_fullsized":"2024-08-17T02:29:58.745746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.713219+0000","last_change":"2024-08-17T02:29:57.717139+0000","last_active":"2024-08-17T02:29:58.713219+0000","last_peered":"2024-08-17T02:29:58.713219+0000","last_clean":"2024-08-17T02:29:58.713219+0000","last_became_active":"2024-08-17T02:29:57.716871+0000","last_became_peered":"2024-08-17T02:29:57.716871+0000","last_unstale":"2024-08-17T02:29:58.713219+0000","last_undegraded":"2024-08-17T02:29:58.713219+0000","last_fullsized":"2024-08-17T02:29:58.713219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748826+0000","last_change":"2024-08-17T02:29:58.738374+0000","last_active":"2024-08-17T02:29:58.748826+0000","last_peered":"2024-08-17T02:29:58.748826+0000","last_clean":"2024-08-17T02:29:58.748826+0000","last_became_active":"2024-08-17T02:29:58.735086+0000","last_became_peered":"2024-08-17T02:29:58.735086+0000","last_unstale":"2024-08-17T02:29:58.748826+0000","last_undegraded":"2024-08-17T02:29:58.748826+0000","last_fullsized":"2024-08-17T02:29:58.748826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.110378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724533+0000","last_change":"2024-08-17T02:29:57.718504+0000","last_active":"2024-08-17T02:29:58.724533+0000","last_peered":"2024-08-17T02:29:58.724533+0000","last_clean":"2024-08-17T02:29:58.724533+0000","last_became_active":"2024-08-17T02:29:57.717867+0000","last_became_peered":"2024-08-17T02:29:57.717867+0000","last_unstale":"2024-08-17T02:29:58.724533+0000","last_undegraded":"2024-08-17T02:29:58.724533+0000","last_fullsized":"2024-08-17T02:29:58.724533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745789+0000","last_change":"2024-08-17T02:29:58.736680+0000","last_active":"2024-08-17T02:29:58.745789+0000","last_peered":"2024-08-17T02:29:58.745789+0000","last_clean":"2024-08-17T02:29:58.745789+0000","last_became_active":"2024-08-17T02:29:58.736435+0000","last_became_peered":"2024-08-17T02:29:58.736435+0000","last_unstale":"2024-08-17T02:29:58.745789+0000","last_undegraded":"2024-08-17T02:29:58.745789+0000","last_fullsized":"2024-08-17T02:29:58.745789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712419+0000","last_change":"2024-08-17T02:29:57.721626+0000","last_active":"2024-08-17T02:29:58.712419+0000","last_peered":"2024-08-17T02:29:58.712419+0000","last_clean":"2024-08-17T02:29:58.712419+0000","last_became_active":"2024-08-17T02:29:57.721324+0000","last_became_peered":"2024-08-17T02:29:57.721324+0000","last_unstale":"2024-08-17T02:29:58.712419+0000","last_undegraded":"2024-08-17T02:29:58.712419+0000","last_fullsized":"2024-08-17T02:29:58.712419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738258+0000","last_change":"2024-08-17T02:29:58.735566+0000","last_active":"2024-08-17T02:29:58.738258+0000","last_peered":"2024-08-17T02:29:58.738258+0000","last_clean":"2024-08-17T02:29:58.738258+0000","last_became_active":"2024-08-17T02:29:58.735076+0000","last_became_peered":"2024-08-17T02:29:58.735076+0000","last_unstale":"2024-08-17T02:29:58.738258+0000","last_undegraded":"2024-08-17T02:29:58.738258+0000","last_fullsized":"2024-08-17T02:29:58.738258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:11.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721996+0000","last_change":"2024-08-17T02:29:57.719061+0000","last_active":"2024-08-17T02:29:58.721996+0000","last_peered":"2024-08-17T02:29:58.721996+0000","last_clean":"2024-08-17T02:29:58.721996+0000","last_became_active":"2024-08-17T02:29:57.718710+0000","last_became_peered":"2024-08-17T02:29:57.718710+0000","last_unstale":"2024-08-17T02:29:58.721996+0000","last_undegraded":"2024-08-17T02:29:58.721996+0000","last_fullsized":"2024-08-17T02:29:58.721996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:18.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741483+0000","last_change":"2024-08-17T02:29:58.734533+0000","last_active":"2024-08-17T02:29:58.741483+0000","last_peered":"2024-08-17T02:29:58.741483+0000","last_clean":"2024-08-17T02:29:58.741483+0000","last_became_active":"2024-08-17T02:29:58.733973+0000","last_became_peered":"2024-08-17T02:29:58.733973+0000","last_unstale":"2024-08-17T02:29:58.741483+0000","last_undegraded":"2024-08-17T02:29:58.741483+0000","last_fullsized":"2024-08-17T02:29:58.741483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:09.843119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.718432+0000","last_change":"2024-08-17T02:29:57.729531+0000","last_active":"2024-08-17T02:29:58.718432+0000","last_peered":"2024-08-17T02:29:58.718432+0000","last_clean":"2024-08-17T02:29:58.718432+0000","last_became_active":"2024-08-17T02:29:57.729199+0000","last_became_peered":"2024-08-17T02:29:57.729199+0000","last_unstale":"2024-08-17T02:29:58.718432+0000","last_undegraded":"2024-08-17T02:29:58.718432+0000","last_fullsized":"2024-08-17T02:29:58.718432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:44.243269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745247+0000","last_change":"2024-08-17T02:29:58.741796+0000","last_active":"2024-08-17T02:29:58.745247+0000","last_peered":"2024-08-17T02:29:58.745247+0000","last_clean":"2024-08-17T02:29:58.745247+0000","last_became_active":"2024-08-17T02:29:58.736197+0000","last_became_peered":"2024-08-17T02:29:58.736197+0000","last_unstale":"2024-08-17T02:29:58.745247+0000","last_undegraded":"2024-08-17T02:29:58.745247+0000","last_fullsized":"2024-08-17T02:29:58.745247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724160+0000","last_change":"2024-08-17T02:29:57.726131+0000","last_active":"2024-08-17T02:29:58.724160+0000","last_peered":"2024-08-17T02:29:58.724160+0000","last_clean":"2024-08-17T02:29:58.724160+0000","last_became_active":"2024-08-17T02:29:57.725827+0000","last_became_peered":"2024-08-17T02:29:57.725827+0000","last_unstale":"2024-08-17T02:29:58.724160+0000","last_undegraded":"2024-08-17T02:29:58.724160+0000","last_fullsized":"2024-08-17T02:29:58.724160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.722721+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:58.722721+0000","last_peered":"2024-08-17T02:29:58.722721+0000","last_clean":"2024-08-17T02:29:58.722721+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:58.722721+0000","last_undegraded":"2024-08-17T02:29:58.722721+0000","last_fullsized":"2024-08-17T02:29:58.722721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":966656,"data_stored":732114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":372736,"data_stored":141726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":962560,"data_stored":732024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:03.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:30:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.875+0000 7fef04000640 1 Processor -- start 2024-08-17T02:30:03.876 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.875+0000 7fef04000640 1 -- start start 2024-08-17T02:30:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.876+0000 7fef04000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feefc15a090 0x7feefc0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.877 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.876+0000 7fef04000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0afb50 con 0x7feefc0af6d0 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.876+0000 7fef04000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feefc0abc80 con 0x7feefc158cb0 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.876+0000 7fef04000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feefc0aae50 con 0x7feefc15a090 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef02000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feefc15a090 0x7feefc0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef00c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7feefc0af6d0 0x7feefc0ac820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37726/0 (socket says 172.21.15.110:37726) 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef00c00640 1 -- 172.21.15.110:0/3371916169 learned_addr learned my addr 172.21.15.110:0/3371916169 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef02000640 1 -- 172.21.15.110:0/3371916169 >> v1:172.21.15.177:6789/0 conn(0x7feefc158cb0 legacy=0x7feefc0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef02000640 1 -- 172.21.15.110:0/3371916169 >> v1:172.21.15.110:6789/0 conn(0x7feefc0af6d0 legacy=0x7feefc0ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7fef02000640 1 -- 172.21.15.110:0/3371916169 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc0ab070 con 0x7feefc15a090 2024-08-17T02:30:03.878 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.877+0000 7feefbe00640 1 -- 172.21.15.110:0/3371916169 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096697724 0 0) 0x7feee8001110 con 0x7feefc0af6d0 2024-08-17T02:30:03.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.878+0000 7fef02000640 1 --2- 172.21.15.110:0/3371916169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc15a090 0x7feefc0aa910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feef4009e60 tx=0x7feef4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb44021deec0c3f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.878+0000 7feefbe00640 1 -- 172.21.15.110:0/3371916169 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4007550 con 0x7feefc15a090 2024-08-17T02:30:03.879 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.878+0000 7feefbe00640 1 -- 172.21.15.110:0/3371916169 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef402d050 con 0x7feefc15a090 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7feefbe00640 1 -- 172.21.15.110:0/3371916169 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef4007900 con 0x7feefc15a090 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 -- 172.21.15.110:0/3371916169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc15a090 msgr2=0x7feefc0aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 --2- 172.21.15.110:0/3371916169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc15a090 0x7feefc0aa910 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feef4009e60 tx=0x7feef4009780 comp rx=0 tx=0).stop 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 -- 172.21.15.110:0/3371916169 shutdown_connections 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 --2- 172.21.15.110:0/3371916169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc15a090 0x7feefc0aa910 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 -- 172.21.15.110:0/3371916169 >> 172.21.15.110:0/3371916169 conn(0x7feefc096a70 msgr2=0x7feefc096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 -- 172.21.15.110:0/3371916169 shutdown_connections 2024-08-17T02:30:03.880 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.879+0000 7fef04000640 1 -- 172.21.15.110:0/3371916169 wait complete. 2024-08-17T02:30:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.880+0000 7fef04000640 1 Processor -- start 2024-08-17T02:30:03.881 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 -- start start 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 0x7feefc155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 0x7feefc1690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc0b1070 con 0x7feefc0af6d0 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feefc152990 con 0x7feefc15a090 2024-08-17T02:30:03.882 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.881+0000 7fef04000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feefc169d10 con 0x7feefc158cb0 2024-08-17T02:30:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34914/0 (socket says 172.21.15.110:34914) 2024-08-17T02:30:03.883 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 -- 172.21.15.110:0/2105024826 learned_addr learned my addr 172.21.15.110:0/2105024826 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef02000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 0x7feefc1690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 -- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 msgr2=0x7feefc155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef00c00640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 0x7feefc155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 0x7feefc155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 -- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 msgr2=0x7feefc1690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 0x7feefc1690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 -- 172.21.15.110:0/2105024826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4009a20 con 0x7feefc0af6d0 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef02000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 0x7feefc1690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:03.884 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef00c00640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 0x7feefc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.882+0000 7fef01600640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feef000c560 tx=0x7feef0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.883+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011590 con 0x7feefc0af6d0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.883+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0011710 con 0x7feefc0af6d0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.883+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0011ad0 con 0x7feefc0af6d0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.883+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc169ff0 con 0x7feefc0af6d0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.883+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feefc0b0d00 con 0x7feefc0af6d0 2024-08-17T02:30:03.885 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.884+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feefc064db0 con 0x7feefc0af6d0 2024-08-17T02:30:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.885+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feef001b3b0 con 0x7feefc0af6d0 2024-08-17T02:30:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.885+0000 7feef8c00640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.885+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feef0081a90 con 0x7feefc0af6d0 2024-08-17T02:30:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.886+0000 7fef00c00640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:03.886 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.886+0000 7fef00c00640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 0x7feedc067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feefc166cd0 tx=0x7feee8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:03.889 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:03.889+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feef004fab0 con 0x7feefc0af6d0 2024-08-17T02:30:04.126 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.126+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7feefc069a40 con 0x7feefc0af6d0 2024-08-17T02:30:04.127 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.127+0000 7feef8c00640 1 -- 172.21.15.110:0/2105024826 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1562 (secure 0 0 0) 0x7feef0017020 con 0x7feefc0af6d0 2024-08-17T02:30:04.127 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:04.127 INFO:teuthology.orchestra.run.smithi110.stdout:{"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861742,"num_in_osds":8,"osd_in_since":1723861733,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592706,"bytes_used":2457227264,"bytes_avail":770636886016,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4920}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-08-17T02:30:03.447338+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-17T02:30:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 msgr2=0x7feedc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 0x7feedc067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feefc166cd0 tx=0x7feee8009040 comp rx=0 tx=0).stop 2024-08-17T02:30:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 msgr2=0x7feefc1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.129 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feef000c560 tx=0x7feef0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 shutdown_connections 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7feedc065150 0x7feedc067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feefc15a090 0x7feefc1690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feefc158cb0 0x7feefc155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 --2- 172.21.15.110:0/2105024826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feefc0af6d0 0x7feefc1552e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 >> 172.21.15.110:0/2105024826 conn(0x7feefc096a70 msgr2=0x7feefc1566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 shutdown_connections 2024-08-17T02:30:04.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.129+0000 7fef04000640 1 -- 172.21.15.110:0/2105024826 wait complete. 2024-08-17T02:30:04.143 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:30:04.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:04.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.292+0000 7f84ada00640 1 Processor -- start 2024-08-17T02:30:04.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.292+0000 7f84ada00640 1 -- start start 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 0x7f84a806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84a80aa7d0 0x7f84a8158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 0x7f84a80ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80ac400 con 0x7f84a80aa7d0 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80a9a10 con 0x7f84a806da20 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84ada00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80a9cf0 con 0x7f84a8158dd0 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.293+0000 7f84a6000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84a80aa7d0 0x7f84a8158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84a80aa7d0 0x7f84a8158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34924/0 (socket says 172.21.15.110:34924) 2024-08-17T02:30:04.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 -- 172.21.15.110:0/738497692 learned_addr learned my addr 172.21.15.110:0/738497692 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:04.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a7400640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 0x7f84a80ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6a00640 1 --2- 172.21.15.110:0/738497692 >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 0x7f84a806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 -- 172.21.15.110:0/738497692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 msgr2=0x7f84a80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:04.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 0x7f84a80ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 -- 172.21.15.110:0/738497692 >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 msgr2=0x7f84a806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 --2- 172.21.15.110:0/738497692 >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 0x7f84a806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6000640 1 -- 172.21.15.110:0/738497692 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80a9fd0 con 0x7f84a80aa7d0 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a6a00640 1 --2- 172.21.15.110:0/738497692 >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 0x7f84a806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.294+0000 7f84a7400640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 0x7f84a80ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.295+0000 7f84a6000640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a8158890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84a8068280 tx=0x7f84940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8d100bda008d46 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.295+0000 7f84a5600640 1 -- 172.21.15.110:0/738497692 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849402ad40 con 0x7f84a80aa7d0 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.295+0000 7f84a5600640 1 -- 172.21.15.110:0/738497692 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494032440 con 0x7f84a80aa7d0 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.295+0000 7f84a5600640 1 -- 172.21.15.110:0/738497692 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849402aea0 con 0x7f84a80aa7d0 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 -- 172.21.15.110:0/738497692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 msgr2=0x7f84a8158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a8158890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84a8068280 tx=0x7f84940091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 -- 172.21.15.110:0/738497692 shutdown_connections 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a8158dd0 0x7f84a80ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 --2- 172.21.15.110:0/738497692 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a8158890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 --2- 172.21.15.110:0/738497692 >> v2:172.21.15.177:3300/0 conn(0x7f84a806da20 0x7f84a806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 -- 172.21.15.110:0/738497692 >> 172.21.15.110:0/738497692 conn(0x7f84a80cb9b0 msgr2=0x7f84a80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:04.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 -- 172.21.15.110:0/738497692 shutdown_connections 2024-08-17T02:30:04.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.296+0000 7f84ada00640 1 -- 172.21.15.110:0/738497692 wait complete. 2024-08-17T02:30:04.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.297+0000 7f84ada00640 1 Processor -- start 2024-08-17T02:30:04.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.297+0000 7f84ada00640 1 -- start start 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a806da20 0x7f84a80cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a8158dd0 0x7f84a8157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c9d20 con 0x7f84a80aa7d0 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80ca000 con 0x7f84a8158dd0 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.298+0000 7f84ada00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80ca2e0 con 0x7f84a806da20 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34940/0 (socket says 172.21.15.110:34940) 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 -- 172.21.15.110:0/4183073083 learned_addr learned my addr 172.21.15.110:0/4183073083 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6a00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a806da20 0x7f84a80cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a7400640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a8158dd0 0x7f84a8157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 -- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a806da20 msgr2=0x7f84a80cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a806da20 0x7f84a80cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 -- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a8158dd0 msgr2=0x7f84a8157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a8158dd0 0x7f84a8157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 -- 172.21.15.110:0/4183073083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009450 con 0x7f84a80aa7d0 2024-08-17T02:30:04.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.299+0000 7f84a6000640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8494035040 tx=0x7f8494032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.300+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494031a60 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.300+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494031be0 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.300+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849403d420 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.300+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a80ca5c0 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.300+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a80c99b0 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.301+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a80b1b80 con 0x7f84a80aa7d0 2024-08-17T02:30:04.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.302+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8494039040 con 0x7f84a80aa7d0 2024-08-17T02:30:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.302+0000 7f849e000640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.302+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84940a2160 con 0x7f84a80aa7d0 2024-08-17T02:30:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.303+0000 7f84a6a00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:04.303 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.303+0000 7f84a6a00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 0x7f8488067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f849800aa60 tx=0x7f8498008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:04.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.306+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84a80b1b80 con 0x7f84a80aa7d0 2024-08-17T02:30:04.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.475+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84a80b1b80 con 0x7f8488065150 2024-08-17T02:30:04.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.482+0000 7f849e000640 1 -- 172.21.15.110:0/4183073083 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267891 (secure 0 0 0) 0x7f84a80b1b80 con 0x7f8488065150 2024-08-17T02:30:04.485 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:04.486 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 msgr2=0x7f8488067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 0x7f8488067600 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f849800aa60 tx=0x7f8498008040 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 msgr2=0x7f84a815b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8494035040 tx=0x7f8494032000 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 shutdown_connections 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8488065150 0x7f8488067600 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84a8158dd0 0x7f84a8157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84a80aa7d0 0x7f84a815b240 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 --2- 172.21.15.110:0/4183073083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84a806da20 0x7f84a80cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.485+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 >> 172.21.15.110:0/4183073083 conn(0x7f84a80cb9b0 msgr2=0x7f84a80ac710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:04.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.486+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 shutdown_connections 2024-08-17T02:30:04.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:04.486+0000 7f84ada00640 1 -- 172.21.15.110:0/4183073083 wait complete. 2024-08-17T02:30:04.500 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-08-17T02:30:03.447064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399636,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575084,"statfs":{"total":773094113280,"available":770636886016,"internally_reserved":0,"allocated":4202496,"data_stored":2318660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000891"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749314+0000","last_change":"2024-08-17T02:29:58.741643+0000","last_active":"2024-08-17T02:29:58.749314+0000","last_peered":"2024-08-17T02:29:58.749314+0000","last_clean":"2024-08-17T02:29:58.749314+0000","last_became_active":"2024-08-17T02:29:58.739611+0000","last_became_peered":"2024-08-17T02:29:58.739611+0000","last_unstale":"2024-08-17T02:29:58.749314+0000","last_undegraded":"2024-08-17T02:29:58.749314+0000","last_fullsized":"2024-08-17T02:29:58.749314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746988+0000","last_change":"2024-08-17T02:29:58.743692+0000","last_active":"2024-08-17T02:29:58.746988+0000","last_peered":"2024-08-17T02:29:58.746988+0000","last_clean":"2024-08-17T02:29:58.746988+0000","last_became_active":"2024-08-17T02:29:58.741923+0000","last_became_peered":"2024-08-17T02:29:58.741923+0000","last_unstale":"2024-08-17T02:29:58.746988+0000","last_undegraded":"2024-08-17T02:29:58.746988+0000","last_fullsized":"2024-08-17T02:29:58.746988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750639+0000","last_change":"2024-08-17T02:29:58.743429+0000","last_active":"2024-08-17T02:29:58.750639+0000","last_peered":"2024-08-17T02:29:58.750639+0000","last_clean":"2024-08-17T02:29:58.750639+0000","last_became_active":"2024-08-17T02:29:58.742398+0000","last_became_peered":"2024-08-17T02:29:58.742398+0000","last_unstale":"2024-08-17T02:29:58.750639+0000","last_undegraded":"2024-08-17T02:29:58.750639+0000","last_fullsized":"2024-08-17T02:29:58.750639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742741+0000","last_change":"2024-08-17T02:29:58.731783+0000","last_active":"2024-08-17T02:29:58.742741+0000","last_peered":"2024-08-17T02:29:58.742741+0000","last_clean":"2024-08-17T02:29:58.742741+0000","last_became_active":"2024-08-17T02:29:58.731530+0000","last_became_peered":"2024-08-17T02:29:58.731530+0000","last_unstale":"2024-08-17T02:29:58.742741+0000","last_undegraded":"2024-08-17T02:29:58.742741+0000","last_fullsized":"2024-08-17T02:29:58.742741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.730477+0000","last_change":"2024-08-17T02:29:58.722268+0000","last_active":"2024-08-17T02:29:58.730477+0000","last_peered":"2024-08-17T02:29:58.730477+0000","last_clean":"2024-08-17T02:29:58.730477+0000","last_became_active":"2024-08-17T02:29:58.721951+0000","last_became_peered":"2024-08-17T02:29:58.721951+0000","last_unstale":"2024-08-17T02:29:58.730477+0000","last_undegraded":"2024-08-17T02:29:58.730477+0000","last_fullsized":"2024-08-17T02:29:58.730477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:24.799353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741898+0000","last_change":"2024-08-17T02:29:58.736216+0000","last_active":"2024-08-17T02:29:58.741898+0000","last_peered":"2024-08-17T02:29:58.741898+0000","last_clean":"2024-08-17T02:29:58.741898+0000","last_became_active":"2024-08-17T02:29:58.735535+0000","last_became_peered":"2024-08-17T02:29:58.735535+0000","last_unstale":"2024-08-17T02:29:58.741898+0000","last_undegraded":"2024-08-17T02:29:58.741898+0000","last_fullsized":"2024-08-17T02:29:58.741898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748584+0000","last_change":"2024-08-17T02:29:58.744028+0000","last_active":"2024-08-17T02:29:58.748584+0000","last_peered":"2024-08-17T02:29:58.748584+0000","last_clean":"2024-08-17T02:29:58.748584+0000","last_became_active":"2024-08-17T02:29:58.743403+0000","last_became_peered":"2024-08-17T02:29:58.743403+0000","last_unstale":"2024-08-17T02:29:58.748584+0000","last_undegraded":"2024-08-17T02:29:58.748584+0000","last_fullsized":"2024-08-17T02:29:58.748584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746871+0000","last_change":"2024-08-17T02:29:58.743182+0000","last_active":"2024-08-17T02:29:58.746871+0000","last_peered":"2024-08-17T02:29:58.746871+0000","last_clean":"2024-08-17T02:29:58.746871+0000","last_became_active":"2024-08-17T02:29:58.742111+0000","last_became_peered":"2024-08-17T02:29:58.742111+0000","last_unstale":"2024-08-17T02:29:58.746871+0000","last_undegraded":"2024-08-17T02:29:58.746871+0000","last_fullsized":"2024-08-17T02:29:58.746871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739442+0000","last_change":"2024-08-17T02:29:58.730907+0000","last_active":"2024-08-17T02:29:58.739442+0000","last_peered":"2024-08-17T02:29:58.739442+0000","last_clean":"2024-08-17T02:29:58.739442+0000","last_became_active":"2024-08-17T02:29:58.727907+0000","last_became_peered":"2024-08-17T02:29:58.727907+0000","last_unstale":"2024-08-17T02:29:58.739442+0000","last_undegraded":"2024-08-17T02:29:58.739442+0000","last_fullsized":"2024-08-17T02:29:58.739442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:53:41.162732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740076+0000","last_change":"2024-08-17T02:29:58.727278+0000","last_active":"2024-08-17T02:29:58.740076+0000","last_peered":"2024-08-17T02:29:58.740076+0000","last_clean":"2024-08-17T02:29:58.740076+0000","last_became_active":"2024-08-17T02:29:58.726951+0000","last_became_peered":"2024-08-17T02:29:58.726951+0000","last_unstale":"2024-08-17T02:29:58.740076+0000","last_undegraded":"2024-08-17T02:29:58.740076+0000","last_fullsized":"2024-08-17T02:29:58.740076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745305+0000","last_change":"2024-08-17T02:29:58.742574+0000","last_active":"2024-08-17T02:29:58.745305+0000","last_peered":"2024-08-17T02:29:58.745305+0000","last_clean":"2024-08-17T02:29:58.745305+0000","last_became_active":"2024-08-17T02:29:58.742198+0000","last_became_peered":"2024-08-17T02:29:58.742198+0000","last_unstale":"2024-08-17T02:29:58.745305+0000","last_undegraded":"2024-08-17T02:29:58.745305+0000","last_fullsized":"2024-08-17T02:29:58.745305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743782+0000","last_change":"2024-08-17T02:29:58.740386+0000","last_active":"2024-08-17T02:29:58.743782+0000","last_peered":"2024-08-17T02:29:58.743782+0000","last_clean":"2024-08-17T02:29:58.743782+0000","last_became_active":"2024-08-17T02:29:58.740099+0000","last_became_peered":"2024-08-17T02:29:58.740099+0000","last_unstale":"2024-08-17T02:29:58.743782+0000","last_undegraded":"2024-08-17T02:29:58.743782+0000","last_fullsized":"2024-08-17T02:29:58.743782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732844+0000","last_change":"2024-08-17T02:29:58.724858+0000","last_active":"2024-08-17T02:29:58.732844+0000","last_peered":"2024-08-17T02:29:58.732844+0000","last_clean":"2024-08-17T02:29:58.732844+0000","last_became_active":"2024-08-17T02:29:58.724544+0000","last_became_peered":"2024-08-17T02:29:58.724544+0000","last_unstale":"2024-08-17T02:29:58.732844+0000","last_undegraded":"2024-08-17T02:29:58.732844+0000","last_fullsized":"2024-08-17T02:29:58.732844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:42.188722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746925+0000","last_change":"2024-08-17T02:29:58.742560+0000","last_active":"2024-08-17T02:29:58.746925+0000","last_peered":"2024-08-17T02:29:58.746925+0000","last_clean":"2024-08-17T02:29:58.746925+0000","last_became_active":"2024-08-17T02:29:58.742283+0000","last_became_peered":"2024-08-17T02:29:58.742283+0000","last_unstale":"2024-08-17T02:29:58.746925+0000","last_undegraded":"2024-08-17T02:29:58.746925+0000","last_fullsized":"2024-08-17T02:29:58.746925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753162+0000","last_change":"2024-08-17T02:29:58.751517+0000","last_active":"2024-08-17T02:29:58.753162+0000","last_peered":"2024-08-17T02:29:58.753162+0000","last_clean":"2024-08-17T02:29:58.753162+0000","last_became_active":"2024-08-17T02:29:58.750958+0000","last_became_peered":"2024-08-17T02:29:58.750958+0000","last_unstale":"2024-08-17T02:29:58.753162+0000","last_undegraded":"2024-08-17T02:29:58.753162+0000","last_fullsized":"2024-08-17T02:29:58.753162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746926+0000","last_change":"2024-08-17T02:29:58.743516+0000","last_active":"2024-08-17T02:29:58.746926+0000","last_peered":"2024-08-17T02:29:58.746926+0000","last_clean":"2024-08-17T02:29:58.746926+0000","last_became_active":"2024-08-17T02:29:58.742817+0000","last_became_peered":"2024-08-17T02:29:58.742817+0000","last_unstale":"2024-08-17T02:29:58.746926+0000","last_undegraded":"2024-08-17T02:29:58.746926+0000","last_fullsized":"2024-08-17T02:29:58.746926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751410+0000","last_change":"2024-08-17T02:29:58.748884+0000","last_active":"2024-08-17T02:29:58.751410+0000","last_peered":"2024-08-17T02:29:58.751410+0000","last_clean":"2024-08-17T02:29:58.751410+0000","last_became_active":"2024-08-17T02:29:58.746711+0000","last_became_peered":"2024-08-17T02:29:58.746711+0000","last_unstale":"2024-08-17T02:29:58.751410+0000","last_undegraded":"2024-08-17T02:29:58.751410+0000","last_fullsized":"2024-08-17T02:29:58.751410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738331+0000","last_change":"2024-08-17T02:29:58.730041+0000","last_active":"2024-08-17T02:29:58.738331+0000","last_peered":"2024-08-17T02:29:58.738331+0000","last_clean":"2024-08-17T02:29:58.738331+0000","last_became_active":"2024-08-17T02:29:58.729760+0000","last_became_peered":"2024-08-17T02:29:58.729760+0000","last_unstale":"2024-08-17T02:29:58.738331+0000","last_undegraded":"2024-08-17T02:29:58.738331+0000","last_fullsized":"2024-08-17T02:29:58.738331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:40.726566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744180+0000","last_change":"2024-08-17T02:29:58.741199+0000","last_active":"2024-08-17T02:29:58.744180+0000","last_peered":"2024-08-17T02:29:58.744180+0000","last_clean":"2024-08-17T02:29:58.744180+0000","last_became_active":"2024-08-17T02:29:58.740700+0000","last_became_peered":"2024-08-17T02:29:58.740700+0000","last_unstale":"2024-08-17T02:29:58.744180+0000","last_undegraded":"2024-08-17T02:29:58.744180+0000","last_fullsized":"2024-08-17T02:29:58.744180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739703+0000","last_change":"2024-08-17T02:29:58.736003+0000","last_active":"2024-08-17T02:29:58.739703+0000","last_peered":"2024-08-17T02:29:58.739703+0000","last_clean":"2024-08-17T02:29:58.739703+0000","last_became_active":"2024-08-17T02:29:58.735774+0000","last_became_peered":"2024-08-17T02:29:58.735774+0000","last_unstale":"2024-08-17T02:29:58.739703+0000","last_undegraded":"2024-08-17T02:29:58.739703+0000","last_fullsized":"2024-08-17T02:29:58.739703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.731002+0000","last_change":"2024-08-17T02:29:58.723426+0000","last_active":"2024-08-17T02:29:58.731002+0000","last_peered":"2024-08-17T02:29:58.731002+0000","last_clean":"2024-08-17T02:29:58.731002+0000","last_became_active":"2024-08-17T02:29:58.723149+0000","last_became_peered":"2024-08-17T02:29:58.723149+0000","last_unstale":"2024-08-17T02:29:58.731002+0000","last_undegraded":"2024-08-17T02:29:58.731002+0000","last_fullsized":"2024-08-17T02:29:58.731002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:10.591085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751621+0000","last_change":"2024-08-17T02:29:58.744330+0000","last_active":"2024-08-17T02:29:58.751621+0000","last_peered":"2024-08-17T02:29:58.751621+0000","last_clean":"2024-08-17T02:29:58.751621+0000","last_became_active":"2024-08-17T02:29:58.744077+0000","last_became_peered":"2024-08-17T02:29:58.744077+0000","last_unstale":"2024-08-17T02:29:58.751621+0000","last_undegraded":"2024-08-17T02:29:58.751621+0000","last_fullsized":"2024-08-17T02:29:58.751621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:14.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747028+0000","last_change":"2024-08-17T02:29:58.744955+0000","last_active":"2024-08-17T02:29:58.747028+0000","last_peered":"2024-08-17T02:29:58.747028+0000","last_clean":"2024-08-17T02:29:58.747028+0000","last_became_active":"2024-08-17T02:29:58.744686+0000","last_became_peered":"2024-08-17T02:29:58.744686+0000","last_unstale":"2024-08-17T02:29:58.747028+0000","last_undegraded":"2024-08-17T02:29:58.747028+0000","last_fullsized":"2024-08-17T02:29:58.747028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:53.311811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742076+0000","last_change":"2024-08-17T02:29:58.737198+0000","last_active":"2024-08-17T02:29:58.742076+0000","last_peered":"2024-08-17T02:29:58.742076+0000","last_clean":"2024-08-17T02:29:58.742076+0000","last_became_active":"2024-08-17T02:29:58.736888+0000","last_became_peered":"2024-08-17T02:29:58.736888+0000","last_unstale":"2024-08-17T02:29:58.742076+0000","last_undegraded":"2024-08-17T02:29:58.742076+0000","last_fullsized":"2024-08-17T02:29:58.742076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743098+0000","last_change":"2024-08-17T02:29:58.734524+0000","last_active":"2024-08-17T02:29:58.743098+0000","last_peered":"2024-08-17T02:29:58.743098+0000","last_clean":"2024-08-17T02:29:58.743098+0000","last_became_active":"2024-08-17T02:29:58.734301+0000","last_became_peered":"2024-08-17T02:29:58.734301+0000","last_unstale":"2024-08-17T02:29:58.743098+0000","last_undegraded":"2024-08-17T02:29:58.743098+0000","last_fullsized":"2024-08-17T02:29:58.743098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:04.992743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741696+0000","last_change":"2024-08-17T02:29:58.740075+0000","last_active":"2024-08-17T02:29:58.741696+0000","last_peered":"2024-08-17T02:29:58.741696+0000","last_clean":"2024-08-17T02:29:58.741696+0000","last_became_active":"2024-08-17T02:29:58.738155+0000","last_became_peered":"2024-08-17T02:29:58.738155+0000","last_unstale":"2024-08-17T02:29:58.741696+0000","last_undegraded":"2024-08-17T02:29:58.741696+0000","last_fullsized":"2024-08-17T02:29:58.741696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:30.461064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743326+0000","last_change":"2024-08-17T02:29:58.733055+0000","last_active":"2024-08-17T02:29:58.743326+0000","last_peered":"2024-08-17T02:29:58.743326+0000","last_clean":"2024-08-17T02:29:58.743326+0000","last_became_active":"2024-08-17T02:29:58.732825+0000","last_became_peered":"2024-08-17T02:29:58.732825+0000","last_unstale":"2024-08-17T02:29:58.743326+0000","last_undegraded":"2024-08-17T02:29:58.743326+0000","last_fullsized":"2024-08-17T02:29:58.743326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749674+0000","last_change":"2024-08-17T02:29:58.745816+0000","last_active":"2024-08-17T02:29:58.749674+0000","last_peered":"2024-08-17T02:29:58.749674+0000","last_clean":"2024-08-17T02:29:58.749674+0000","last_became_active":"2024-08-17T02:29:58.745577+0000","last_became_peered":"2024-08-17T02:29:58.745577+0000","last_unstale":"2024-08-17T02:29:58.749674+0000","last_undegraded":"2024-08-17T02:29:58.749674+0000","last_fullsized":"2024-08-17T02:29:58.749674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751986+0000","last_change":"2024-08-17T02:29:58.749463+0000","last_active":"2024-08-17T02:29:58.751986+0000","last_peered":"2024-08-17T02:29:58.751986+0000","last_clean":"2024-08-17T02:29:58.751986+0000","last_became_active":"2024-08-17T02:29:58.747016+0000","last_became_peered":"2024-08-17T02:29:58.747016+0000","last_unstale":"2024-08-17T02:29:58.751986+0000","last_undegraded":"2024-08-17T02:29:58.751986+0000","last_fullsized":"2024-08-17T02:29:58.751986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:47.734268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749971+0000","last_change":"2024-08-17T02:29:58.746539+0000","last_active":"2024-08-17T02:29:58.749971+0000","last_peered":"2024-08-17T02:29:58.749971+0000","last_clean":"2024-08-17T02:29:58.749971+0000","last_became_active":"2024-08-17T02:29:58.746229+0000","last_became_peered":"2024-08-17T02:29:58.746229+0000","last_unstale":"2024-08-17T02:29:58.749971+0000","last_undegraded":"2024-08-17T02:29:58.749971+0000","last_fullsized":"2024-08-17T02:29:58.749971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749209+0000","last_change":"2024-08-17T02:29:58.741822+0000","last_active":"2024-08-17T02:29:58.749209+0000","last_peered":"2024-08-17T02:29:58.749209+0000","last_clean":"2024-08-17T02:29:58.749209+0000","last_became_active":"2024-08-17T02:29:58.741389+0000","last_became_peered":"2024-08-17T02:29:58.741389+0000","last_unstale":"2024-08-17T02:29:58.749209+0000","last_undegraded":"2024-08-17T02:29:58.749209+0000","last_fullsized":"2024-08-17T02:29:58.749209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744371+0000","last_change":"2024-08-17T02:29:58.738700+0000","last_active":"2024-08-17T02:29:58.744371+0000","last_peered":"2024-08-17T02:29:58.744371+0000","last_clean":"2024-08-17T02:29:58.744371+0000","last_became_active":"2024-08-17T02:29:58.738357+0000","last_became_peered":"2024-08-17T02:29:58.738357+0000","last_unstale":"2024-08-17T02:29:58.744371+0000","last_undegraded":"2024-08-17T02:29:58.744371+0000","last_fullsized":"2024-08-17T02:29:58.744371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745622+0000","last_change":"2024-08-17T02:29:58.742020+0000","last_active":"2024-08-17T02:29:58.745622+0000","last_peered":"2024-08-17T02:29:58.745622+0000","last_clean":"2024-08-17T02:29:58.745622+0000","last_became_active":"2024-08-17T02:29:58.741761+0000","last_became_peered":"2024-08-17T02:29:58.741761+0000","last_unstale":"2024-08-17T02:29:58.745622+0000","last_undegraded":"2024-08-17T02:29:58.745622+0000","last_fullsized":"2024-08-17T02:29:58.745622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:57.027420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752498+0000","last_change":"2024-08-17T02:29:57.725268+0000","last_active":"2024-08-17T02:29:58.752498+0000","last_peered":"2024-08-17T02:29:58.752498+0000","last_clean":"2024-08-17T02:29:58.752498+0000","last_became_active":"2024-08-17T02:29:57.724838+0000","last_became_peered":"2024-08-17T02:29:57.724838+0000","last_unstale":"2024-08-17T02:29:58.752498+0000","last_undegraded":"2024-08-17T02:29:58.752498+0000","last_fullsized":"2024-08-17T02:29:58.752498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749334+0000","last_change":"2024-08-17T02:29:58.742048+0000","last_active":"2024-08-17T02:29:58.749334+0000","last_peered":"2024-08-17T02:29:58.749334+0000","last_clean":"2024-08-17T02:29:58.749334+0000","last_became_active":"2024-08-17T02:29:58.741776+0000","last_became_peered":"2024-08-17T02:29:58.741776+0000","last_unstale":"2024-08-17T02:29:58.749334+0000","last_undegraded":"2024-08-17T02:29:58.749334+0000","last_fullsized":"2024-08-17T02:29:58.749334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:11.094720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749909+0000","last_change":"2024-08-17T02:29:57.728560+0000","last_active":"2024-08-17T02:29:58.749909+0000","last_peered":"2024-08-17T02:29:58.749909+0000","last_clean":"2024-08-17T02:29:58.749909+0000","last_became_active":"2024-08-17T02:29:57.728348+0000","last_became_peered":"2024-08-17T02:29:57.728348+0000","last_unstale":"2024-08-17T02:29:58.749909+0000","last_undegraded":"2024-08-17T02:29:58.749909+0000","last_fullsized":"2024-08-17T02:29:58.749909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751734+0000","last_change":"2024-08-17T02:29:58.747628+0000","last_active":"2024-08-17T02:29:58.751734+0000","last_peered":"2024-08-17T02:29:58.751734+0000","last_clean":"2024-08-17T02:29:58.751734+0000","last_became_active":"2024-08-17T02:29:58.747337+0000","last_became_peered":"2024-08-17T02:29:58.747337+0000","last_unstale":"2024-08-17T02:29:58.751734+0000","last_undegraded":"2024-08-17T02:29:58.751734+0000","last_fullsized":"2024-08-17T02:29:58.751734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:14.428939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748007+0000","last_change":"2024-08-17T02:29:57.717746+0000","last_active":"2024-08-17T02:29:58.748007+0000","last_peered":"2024-08-17T02:29:58.748007+0000","last_clean":"2024-08-17T02:29:58.748007+0000","last_became_active":"2024-08-17T02:29:57.717222+0000","last_became_peered":"2024-08-17T02:29:57.717222+0000","last_unstale":"2024-08-17T02:29:58.748007+0000","last_undegraded":"2024-08-17T02:29:58.748007+0000","last_fullsized":"2024-08-17T02:29:58.748007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:25.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:58.730890+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:58.730471+0000","last_became_peered":"2024-08-17T02:29:58.730471+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:10.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746151+0000","last_change":"2024-08-17T02:29:57.725880+0000","last_active":"2024-08-17T02:29:58.746151+0000","last_peered":"2024-08-17T02:29:58.746151+0000","last_clean":"2024-08-17T02:29:58.746151+0000","last_became_active":"2024-08-17T02:29:57.725454+0000","last_became_peered":"2024-08-17T02:29:57.725454+0000","last_unstale":"2024-08-17T02:29:58.746151+0000","last_undegraded":"2024-08-17T02:29:58.746151+0000","last_fullsized":"2024-08-17T02:29:58.746151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:56.890041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745195+0000","last_change":"2024-08-17T02:29:58.741751+0000","last_active":"2024-08-17T02:29:58.745195+0000","last_peered":"2024-08-17T02:29:58.745195+0000","last_clean":"2024-08-17T02:29:58.745195+0000","last_became_active":"2024-08-17T02:29:58.741574+0000","last_became_peered":"2024-08-17T02:29:58.741574+0000","last_unstale":"2024-08-17T02:29:58.745195+0000","last_undegraded":"2024-08-17T02:29:58.745195+0000","last_fullsized":"2024-08-17T02:29:58.745195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745104+0000","last_change":"2024-08-17T02:29:57.719062+0000","last_active":"2024-08-17T02:29:58.745104+0000","last_peered":"2024-08-17T02:29:58.745104+0000","last_clean":"2024-08-17T02:29:58.745104+0000","last_became_active":"2024-08-17T02:29:57.716423+0000","last_became_peered":"2024-08-17T02:29:57.716423+0000","last_unstale":"2024-08-17T02:29:58.745104+0000","last_undegraded":"2024-08-17T02:29:58.745104+0000","last_fullsized":"2024-08-17T02:29:58.745104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:52.826206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749705+0000","last_change":"2024-08-17T02:29:58.747561+0000","last_active":"2024-08-17T02:29:58.749705+0000","last_peered":"2024-08-17T02:29:58.749705+0000","last_clean":"2024-08-17T02:29:58.749705+0000","last_became_active":"2024-08-17T02:29:58.747006+0000","last_became_peered":"2024-08-17T02:29:58.747006+0000","last_unstale":"2024-08-17T02:29:58.749705+0000","last_undegraded":"2024-08-17T02:29:58.749705+0000","last_fullsized":"2024-08-17T02:29:58.749705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743728+0000","last_change":"2024-08-17T02:29:57.716703+0000","last_active":"2024-08-17T02:29:58.743728+0000","last_peered":"2024-08-17T02:29:58.743728+0000","last_clean":"2024-08-17T02:29:58.743728+0000","last_became_active":"2024-08-17T02:29:57.716398+0000","last_became_peered":"2024-08-17T02:29:57.716398+0000","last_unstale":"2024-08-17T02:29:58.743728+0000","last_undegraded":"2024-08-17T02:29:58.743728+0000","last_fullsized":"2024-08-17T02:29:58.743728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:05:11.190397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741009+0000","last_change":"2024-08-17T02:29:58.736558+0000","last_active":"2024-08-17T02:29:58.741009+0000","last_peered":"2024-08-17T02:29:58.741009+0000","last_clean":"2024-08-17T02:29:58.741009+0000","last_became_active":"2024-08-17T02:29:58.735265+0000","last_became_peered":"2024-08-17T02:29:58.735265+0000","last_unstale":"2024-08-17T02:29:58.741009+0000","last_undegraded":"2024-08-17T02:29:58.741009+0000","last_fullsized":"2024-08-17T02:29:58.741009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:35.180625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717776+0000","last_change":"2024-08-17T02:29:57.717409+0000","last_active":"2024-08-17T02:29:58.717776+0000","last_peered":"2024-08-17T02:29:58.717776+0000","last_clean":"2024-08-17T02:29:58.717776+0000","last_became_active":"2024-08-17T02:29:57.717050+0000","last_became_peered":"2024-08-17T02:29:57.717050+0000","last_unstale":"2024-08-17T02:29:58.717776+0000","last_undegraded":"2024-08-17T02:29:58.717776+0000","last_fullsized":"2024-08-17T02:29:58.717776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:56.020938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740003+0000","last_change":"2024-08-17T02:29:58.728203+0000","last_active":"2024-08-17T02:29:58.740003+0000","last_peered":"2024-08-17T02:29:58.740003+0000","last_clean":"2024-08-17T02:29:58.740003+0000","last_became_active":"2024-08-17T02:29:58.727970+0000","last_became_peered":"2024-08-17T02:29:58.727970+0000","last_unstale":"2024-08-17T02:29:58.740003+0000","last_undegraded":"2024-08-17T02:29:58.740003+0000","last_fullsized":"2024-08-17T02:29:58.740003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:48.051059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.720768+0000","last_change":"2024-08-17T02:29:57.712754+0000","last_active":"2024-08-17T02:29:58.720768+0000","last_peered":"2024-08-17T02:29:58.720768+0000","last_clean":"2024-08-17T02:29:58.720768+0000","last_became_active":"2024-08-17T02:29:57.712420+0000","last_became_peered":"2024-08-17T02:29:57.712420+0000","last_unstale":"2024-08-17T02:29:58.720768+0000","last_undegraded":"2024-08-17T02:29:58.720768+0000","last_fullsized":"2024-08-17T02:29:58.720768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:52.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743754+0000","last_change":"2024-08-17T02:29:58.741449+0000","last_active":"2024-08-17T02:29:58.743754+0000","last_peered":"2024-08-17T02:29:58.743754+0000","last_clean":"2024-08-17T02:29:58.743754+0000","last_became_active":"2024-08-17T02:29:58.741064+0000","last_became_peered":"2024-08-17T02:29:58.741064+0000","last_unstale":"2024-08-17T02:29:58.743754+0000","last_undegraded":"2024-08-17T02:29:58.743754+0000","last_fullsized":"2024-08-17T02:29:58.743754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721533+0000","last_change":"2024-08-17T02:29:57.728908+0000","last_active":"2024-08-17T02:29:58.721533+0000","last_peered":"2024-08-17T02:29:58.721533+0000","last_clean":"2024-08-17T02:29:58.721533+0000","last_became_active":"2024-08-17T02:29:57.728140+0000","last_became_peered":"2024-08-17T02:29:57.728140+0000","last_unstale":"2024-08-17T02:29:58.721533+0000","last_undegraded":"2024-08-17T02:29:58.721533+0000","last_fullsized":"2024-08-17T02:29:58.721533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:52.305329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748869+0000","last_change":"2024-08-17T02:29:58.747780+0000","last_active":"2024-08-17T02:29:58.748869+0000","last_peered":"2024-08-17T02:29:58.748869+0000","last_clean":"2024-08-17T02:29:58.748869+0000","last_became_active":"2024-08-17T02:29:58.747610+0000","last_became_peered":"2024-08-17T02:29:58.747610+0000","last_unstale":"2024-08-17T02:29:58.748869+0000","last_undegraded":"2024-08-17T02:29:58.748869+0000","last_fullsized":"2024-08-17T02:29:58.748869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:58.341084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.723686+0000","last_change":"2024-08-17T02:29:57.716795+0000","last_active":"2024-08-17T02:29:58.723686+0000","last_peered":"2024-08-17T02:29:58.723686+0000","last_clean":"2024-08-17T02:29:58.723686+0000","last_became_active":"2024-08-17T02:29:57.716450+0000","last_became_peered":"2024-08-17T02:29:57.716450+0000","last_unstale":"2024-08-17T02:29:58.723686+0000","last_undegraded":"2024-08-17T02:29:58.723686+0000","last_fullsized":"2024-08-17T02:29:58.723686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740858+0000","last_change":"2024-08-17T02:29:58.739170+0000","last_active":"2024-08-17T02:29:58.740858+0000","last_peered":"2024-08-17T02:29:58.740858+0000","last_clean":"2024-08-17T02:29:58.740858+0000","last_became_active":"2024-08-17T02:29:58.738402+0000","last_became_peered":"2024-08-17T02:29:58.738402+0000","last_unstale":"2024-08-17T02:29:58.740858+0000","last_undegraded":"2024-08-17T02:29:58.740858+0000","last_fullsized":"2024-08-17T02:29:58.740858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:00.940495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:57.728489+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:57.728142+0000","last_became_peered":"2024-08-17T02:29:57.728142+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750659+0000","last_change":"2024-08-17T02:29:58.743587+0000","last_active":"2024-08-17T02:29:58.750659+0000","last_peered":"2024-08-17T02:29:58.750659+0000","last_clean":"2024-08-17T02:29:58.750659+0000","last_became_active":"2024-08-17T02:29:58.742775+0000","last_became_peered":"2024-08-17T02:29:58.742775+0000","last_unstale":"2024-08-17T02:29:58.750659+0000","last_undegraded":"2024-08-17T02:29:58.750659+0000","last_fullsized":"2024-08-17T02:29:58.750659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753775+0000","last_change":"2024-08-17T02:29:57.721570+0000","last_active":"2024-08-17T02:29:58.753775+0000","last_peered":"2024-08-17T02:29:58.753775+0000","last_clean":"2024-08-17T02:29:58.753775+0000","last_became_active":"2024-08-17T02:29:57.721294+0000","last_became_peered":"2024-08-17T02:29:57.721294+0000","last_unstale":"2024-08-17T02:29:58.753775+0000","last_undegraded":"2024-08-17T02:29:58.753775+0000","last_fullsized":"2024-08-17T02:29:58.753775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:52.103896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743390+0000","last_change":"2024-08-17T02:29:58.735104+0000","last_active":"2024-08-17T02:29:58.743390+0000","last_peered":"2024-08-17T02:29:58.743390+0000","last_clean":"2024-08-17T02:29:58.743390+0000","last_became_active":"2024-08-17T02:29:58.733757+0000","last_became_peered":"2024-08-17T02:29:58.733757+0000","last_unstale":"2024-08-17T02:29:58.743390+0000","last_undegraded":"2024-08-17T02:29:58.743390+0000","last_fullsized":"2024-08-17T02:29:58.743390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:30.822073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750467+0000","last_change":"2024-08-17T02:29:57.719687+0000","last_active":"2024-08-17T02:29:58.750467+0000","last_peered":"2024-08-17T02:29:58.750467+0000","last_clean":"2024-08-17T02:29:58.750467+0000","last_became_active":"2024-08-17T02:29:57.719440+0000","last_became_peered":"2024-08-17T02:29:57.719440+0000","last_unstale":"2024-08-17T02:29:58.750467+0000","last_undegraded":"2024-08-17T02:29:58.750467+0000","last_fullsized":"2024-08-17T02:29:58.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:07.181032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748880+0000","last_change":"2024-08-17T02:29:58.748038+0000","last_active":"2024-08-17T02:29:58.748880+0000","last_peered":"2024-08-17T02:29:58.748880+0000","last_clean":"2024-08-17T02:29:58.748880+0000","last_became_active":"2024-08-17T02:29:58.747877+0000","last_became_peered":"2024-08-17T02:29:58.747877+0000","last_unstale":"2024-08-17T02:29:58.748880+0000","last_undegraded":"2024-08-17T02:29:58.748880+0000","last_fullsized":"2024-08-17T02:29:58.748880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712308+0000","last_change":"2024-08-17T02:29:57.723447+0000","last_active":"2024-08-17T02:29:58.712308+0000","last_peered":"2024-08-17T02:29:58.712308+0000","last_clean":"2024-08-17T02:29:58.712308+0000","last_became_active":"2024-08-17T02:29:57.723180+0000","last_became_peered":"2024-08-17T02:29:57.723180+0000","last_unstale":"2024-08-17T02:29:58.712308+0000","last_undegraded":"2024-08-17T02:29:58.712308+0000","last_fullsized":"2024-08-17T02:29:58.712308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746908+0000","last_change":"2024-08-17T02:29:58.743362+0000","last_active":"2024-08-17T02:29:58.746908+0000","last_peered":"2024-08-17T02:29:58.746908+0000","last_clean":"2024-08-17T02:29:58.746908+0000","last_became_active":"2024-08-17T02:29:58.742468+0000","last_became_peered":"2024-08-17T02:29:58.742468+0000","last_unstale":"2024-08-17T02:29:58.746908+0000","last_undegraded":"2024-08-17T02:29:58.746908+0000","last_fullsized":"2024-08-17T02:29:58.746908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717873+0000","last_change":"2024-08-17T02:29:57.728229+0000","last_active":"2024-08-17T02:29:58.717873+0000","last_peered":"2024-08-17T02:29:58.717873+0000","last_clean":"2024-08-17T02:29:58.717873+0000","last_became_active":"2024-08-17T02:29:57.727932+0000","last_became_peered":"2024-08-17T02:29:57.727932+0000","last_unstale":"2024-08-17T02:29:58.717873+0000","last_undegraded":"2024-08-17T02:29:58.717873+0000","last_fullsized":"2024-08-17T02:29:58.717873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749191+0000","last_change":"2024-08-17T02:29:58.741671+0000","last_active":"2024-08-17T02:29:58.749191+0000","last_peered":"2024-08-17T02:29:58.749191+0000","last_clean":"2024-08-17T02:29:58.749191+0000","last_became_active":"2024-08-17T02:29:58.741045+0000","last_became_peered":"2024-08-17T02:29:58.741045+0000","last_unstale":"2024-08-17T02:29:58.749191+0000","last_undegraded":"2024-08-17T02:29:58.749191+0000","last_fullsized":"2024-08-17T02:29:58.749191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:26.986040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751388+0000","last_change":"2024-08-17T02:29:57.719498+0000","last_active":"2024-08-17T02:29:58.751388+0000","last_peered":"2024-08-17T02:29:58.751388+0000","last_clean":"2024-08-17T02:29:58.751388+0000","last_became_active":"2024-08-17T02:29:57.719204+0000","last_became_peered":"2024-08-17T02:29:57.719204+0000","last_unstale":"2024-08-17T02:29:58.751388+0000","last_undegraded":"2024-08-17T02:29:58.751388+0000","last_fullsized":"2024-08-17T02:29:58.751388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:15.868133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741526+0000","last_change":"2024-08-17T02:29:58.735615+0000","last_active":"2024-08-17T02:29:58.741526+0000","last_peered":"2024-08-17T02:29:58.741526+0000","last_clean":"2024-08-17T02:29:58.741526+0000","last_became_active":"2024-08-17T02:29:58.735282+0000","last_became_peered":"2024-08-17T02:29:58.735282+0000","last_unstale":"2024-08-17T02:29:58.741526+0000","last_undegraded":"2024-08-17T02:29:58.741526+0000","last_fullsized":"2024-08-17T02:29:58.741526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:57.528270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747001+0000","last_change":"2024-08-17T02:29:57.717880+0000","last_active":"2024-08-17T02:29:58.747001+0000","last_peered":"2024-08-17T02:29:58.747001+0000","last_clean":"2024-08-17T02:29:58.747001+0000","last_became_active":"2024-08-17T02:29:57.717512+0000","last_became_peered":"2024-08-17T02:29:57.717512+0000","last_unstale":"2024-08-17T02:29:58.747001+0000","last_undegraded":"2024-08-17T02:29:58.747001+0000","last_fullsized":"2024-08-17T02:29:58.747001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752046+0000","last_change":"2024-08-17T02:29:58.750227+0000","last_active":"2024-08-17T02:29:58.752046+0000","last_peered":"2024-08-17T02:29:58.752046+0000","last_clean":"2024-08-17T02:29:58.752046+0000","last_became_active":"2024-08-17T02:29:58.749963+0000","last_became_peered":"2024-08-17T02:29:58.749963+0000","last_unstale":"2024-08-17T02:29:58.752046+0000","last_undegraded":"2024-08-17T02:29:58.752046+0000","last_fullsized":"2024-08-17T02:29:58.752046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750058+0000","last_change":"2024-08-17T02:29:57.712758+0000","last_active":"2024-08-17T02:29:58.750058+0000","last_peered":"2024-08-17T02:29:58.750058+0000","last_clean":"2024-08-17T02:29:58.750058+0000","last_became_active":"2024-08-17T02:29:57.712427+0000","last_became_peered":"2024-08-17T02:29:57.712427+0000","last_unstale":"2024-08-17T02:29:58.750058+0000","last_undegraded":"2024-08-17T02:29:58.750058+0000","last_fullsized":"2024-08-17T02:29:58.750058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:15.716980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742168+0000","last_change":"2024-08-17T02:29:58.730263+0000","last_active":"2024-08-17T02:29:58.742168+0000","last_peered":"2024-08-17T02:29:58.742168+0000","last_clean":"2024-08-17T02:29:58.742168+0000","last_became_active":"2024-08-17T02:29:58.729958+0000","last_became_peered":"2024-08-17T02:29:58.729958+0000","last_unstale":"2024-08-17T02:29:58.742168+0000","last_undegraded":"2024-08-17T02:29:58.742168+0000","last_fullsized":"2024-08-17T02:29:58.742168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738187+0000","last_change":"2024-08-17T02:29:57.720523+0000","last_active":"2024-08-17T02:29:58.738187+0000","last_peered":"2024-08-17T02:29:58.738187+0000","last_clean":"2024-08-17T02:29:58.738187+0000","last_became_active":"2024-08-17T02:29:57.720285+0000","last_became_peered":"2024-08-17T02:29:57.720285+0000","last_unstale":"2024-08-17T02:29:58.738187+0000","last_undegraded":"2024-08-17T02:29:58.738187+0000","last_fullsized":"2024-08-17T02:29:58.738187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:03.855557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746682+0000","last_change":"2024-08-17T02:29:58.741472+0000","last_active":"2024-08-17T02:29:58.746682+0000","last_peered":"2024-08-17T02:29:58.746682+0000","last_clean":"2024-08-17T02:29:58.746682+0000","last_became_active":"2024-08-17T02:29:58.741210+0000","last_became_peered":"2024-08-17T02:29:58.741210+0000","last_unstale":"2024-08-17T02:29:58.746682+0000","last_undegraded":"2024-08-17T02:29:58.746682+0000","last_fullsized":"2024-08-17T02:29:58.746682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:22.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.725302+0000","last_change":"2024-08-17T02:29:57.717827+0000","last_active":"2024-08-17T02:29:58.725302+0000","last_peered":"2024-08-17T02:29:58.725302+0000","last_clean":"2024-08-17T02:29:58.725302+0000","last_became_active":"2024-08-17T02:29:57.716787+0000","last_became_peered":"2024-08-17T02:29:57.716787+0000","last_unstale":"2024-08-17T02:29:58.725302+0000","last_undegraded":"2024-08-17T02:29:58.725302+0000","last_fullsized":"2024-08-17T02:29:58.725302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:23.126977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.733452+0000","last_change":"2024-08-17T02:29:58.732424+0000","last_active":"2024-08-17T02:29:58.733452+0000","last_peered":"2024-08-17T02:29:58.733452+0000","last_clean":"2024-08-17T02:29:58.733452+0000","last_became_active":"2024-08-17T02:29:58.732155+0000","last_became_peered":"2024-08-17T02:29:58.732155+0000","last_unstale":"2024-08-17T02:29:58.733452+0000","last_undegraded":"2024-08-17T02:29:58.733452+0000","last_fullsized":"2024-08-17T02:29:58.733452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:49.295779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747704+0000","last_change":"2024-08-17T02:29:57.720005+0000","last_active":"2024-08-17T02:29:58.747704+0000","last_peered":"2024-08-17T02:29:58.747704+0000","last_clean":"2024-08-17T02:29:58.747704+0000","last_became_active":"2024-08-17T02:29:57.719755+0000","last_became_peered":"2024-08-17T02:29:57.719755+0000","last_unstale":"2024-08-17T02:29:58.747704+0000","last_undegraded":"2024-08-17T02:29:58.747704+0000","last_fullsized":"2024-08-17T02:29:58.747704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732864+0000","last_change":"2024-08-17T02:29:58.724971+0000","last_active":"2024-08-17T02:29:58.732864+0000","last_peered":"2024-08-17T02:29:58.732864+0000","last_clean":"2024-08-17T02:29:58.732864+0000","last_became_active":"2024-08-17T02:29:58.722256+0000","last_became_peered":"2024-08-17T02:29:58.722256+0000","last_unstale":"2024-08-17T02:29:58.732864+0000","last_undegraded":"2024-08-17T02:29:58.732864+0000","last_fullsized":"2024-08-17T02:29:58.732864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:43.541931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724915+0000","last_change":"2024-08-17T02:29:57.725898+0000","last_active":"2024-08-17T02:29:58.724915+0000","last_peered":"2024-08-17T02:29:58.724915+0000","last_clean":"2024-08-17T02:29:58.724915+0000","last_became_active":"2024-08-17T02:29:57.725628+0000","last_became_peered":"2024-08-17T02:29:57.725628+0000","last_unstale":"2024-08-17T02:29:58.724915+0000","last_undegraded":"2024-08-17T02:29:58.724915+0000","last_fullsized":"2024-08-17T02:29:58.724915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.735480+0000","last_change":"2024-08-17T02:29:58.724432+0000","last_active":"2024-08-17T02:29:58.735480+0000","last_peered":"2024-08-17T02:29:58.735480+0000","last_clean":"2024-08-17T02:29:58.735480+0000","last_became_active":"2024-08-17T02:29:58.724186+0000","last_became_peered":"2024-08-17T02:29:58.724186+0000","last_unstale":"2024-08-17T02:29:58.735480+0000","last_undegraded":"2024-08-17T02:29:58.735480+0000","last_fullsized":"2024-08-17T02:29:58.735480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:34.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721339+0000","last_change":"2024-08-17T02:29:57.717344+0000","last_active":"2024-08-17T02:29:58.721339+0000","last_peered":"2024-08-17T02:29:58.721339+0000","last_clean":"2024-08-17T02:29:58.721339+0000","last_became_active":"2024-08-17T02:29:57.717079+0000","last_became_peered":"2024-08-17T02:29:57.717079+0000","last_unstale":"2024-08-17T02:29:58.721339+0000","last_undegraded":"2024-08-17T02:29:58.721339+0000","last_fullsized":"2024-08-17T02:29:58.721339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:45.092703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748608+0000","last_change":"2024-08-17T02:29:58.744207+0000","last_active":"2024-08-17T02:29:58.748608+0000","last_peered":"2024-08-17T02:29:58.748608+0000","last_clean":"2024-08-17T02:29:58.748608+0000","last_became_active":"2024-08-17T02:29:58.743759+0000","last_became_peered":"2024-08-17T02:29:58.743759+0000","last_unstale":"2024-08-17T02:29:58.748608+0000","last_undegraded":"2024-08-17T02:29:58.748608+0000","last_fullsized":"2024-08-17T02:29:58.748608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.726918+0000","last_change":"2024-08-17T02:29:57.730963+0000","last_active":"2024-08-17T02:29:58.726918+0000","last_peered":"2024-08-17T02:29:58.726918+0000","last_clean":"2024-08-17T02:29:58.726918+0000","last_became_active":"2024-08-17T02:29:57.730724+0000","last_became_peered":"2024-08-17T02:29:57.730724+0000","last_unstale":"2024-08-17T02:29:58.726918+0000","last_undegraded":"2024-08-17T02:29:58.726918+0000","last_fullsized":"2024-08-17T02:29:58.726918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:42.644489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739575+0000","last_change":"2024-08-17T02:29:58.737024+0000","last_active":"2024-08-17T02:29:58.739575+0000","last_peered":"2024-08-17T02:29:58.739575+0000","last_clean":"2024-08-17T02:29:58.739575+0000","last_became_active":"2024-08-17T02:29:58.736783+0000","last_became_peered":"2024-08-17T02:29:58.736783+0000","last_unstale":"2024-08-17T02:29:58.739575+0000","last_undegraded":"2024-08-17T02:29:58.739575+0000","last_fullsized":"2024-08-17T02:29:58.739575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:32.640928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751449+0000","last_change":"2024-08-17T02:29:57.721050+0000","last_active":"2024-08-17T02:29:58.751449+0000","last_peered":"2024-08-17T02:29:58.751449+0000","last_clean":"2024-08-17T02:29:58.751449+0000","last_became_active":"2024-08-17T02:29:57.720746+0000","last_became_peered":"2024-08-17T02:29:57.720746+0000","last_unstale":"2024-08-17T02:29:58.751449+0000","last_undegraded":"2024-08-17T02:29:58.751449+0000","last_fullsized":"2024-08-17T02:29:58.751449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752028+0000","last_change":"2024-08-17T02:29:58.750144+0000","last_active":"2024-08-17T02:29:58.752028+0000","last_peered":"2024-08-17T02:29:58.752028+0000","last_clean":"2024-08-17T02:29:58.752028+0000","last_became_active":"2024-08-17T02:29:58.749895+0000","last_became_peered":"2024-08-17T02:29:58.749895+0000","last_unstale":"2024-08-17T02:29:58.752028+0000","last_undegraded":"2024-08-17T02:29:58.752028+0000","last_fullsized":"2024-08-17T02:29:58.752028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:30:00.074040+0000","last_change":"2024-08-17T02:29:57.723014+0000","last_active":"2024-08-17T02:30:00.074040+0000","last_peered":"2024-08-17T02:30:00.074040+0000","last_clean":"2024-08-17T02:30:00.074040+0000","last_became_active":"2024-08-17T02:29:57.722592+0000","last_became_peered":"2024-08-17T02:29:57.722592+0000","last_unstale":"2024-08-17T02:30:00.074040+0000","last_undegraded":"2024-08-17T02:30:00.074040+0000","last_fullsized":"2024-08-17T02:30:00.074040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745746+0000","last_change":"2024-08-17T02:29:58.733329+0000","last_active":"2024-08-17T02:29:58.745746+0000","last_peered":"2024-08-17T02:29:58.745746+0000","last_clean":"2024-08-17T02:29:58.745746+0000","last_became_active":"2024-08-17T02:29:58.733024+0000","last_became_peered":"2024-08-17T02:29:58.733024+0000","last_unstale":"2024-08-17T02:29:58.745746+0000","last_undegraded":"2024-08-17T02:29:58.745746+0000","last_fullsized":"2024-08-17T02:29:58.745746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.713219+0000","last_change":"2024-08-17T02:29:57.717139+0000","last_active":"2024-08-17T02:29:58.713219+0000","last_peered":"2024-08-17T02:29:58.713219+0000","last_clean":"2024-08-17T02:29:58.713219+0000","last_became_active":"2024-08-17T02:29:57.716871+0000","last_became_peered":"2024-08-17T02:29:57.716871+0000","last_unstale":"2024-08-17T02:29:58.713219+0000","last_undegraded":"2024-08-17T02:29:58.713219+0000","last_fullsized":"2024-08-17T02:29:58.713219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748826+0000","last_change":"2024-08-17T02:29:58.738374+0000","last_active":"2024-08-17T02:29:58.748826+0000","last_peered":"2024-08-17T02:29:58.748826+0000","last_clean":"2024-08-17T02:29:58.748826+0000","last_became_active":"2024-08-17T02:29:58.735086+0000","last_became_peered":"2024-08-17T02:29:58.735086+0000","last_unstale":"2024-08-17T02:29:58.748826+0000","last_undegraded":"2024-08-17T02:29:58.748826+0000","last_fullsized":"2024-08-17T02:29:58.748826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.110378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724533+0000","last_change":"2024-08-17T02:29:57.718504+0000","last_active":"2024-08-17T02:29:58.724533+0000","last_peered":"2024-08-17T02:29:58.724533+0000","last_clean":"2024-08-17T02:29:58.724533+0000","last_became_active":"2024-08-17T02:29:57.717867+0000","last_became_peered":"2024-08-17T02:29:57.717867+0000","last_unstale":"2024-08-17T02:29:58.724533+0000","last_undegraded":"2024-08-17T02:29:58.724533+0000","last_fullsized":"2024-08-17T02:29:58.724533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745789+0000","last_change":"2024-08-17T02:29:58.736680+0000","last_active":"2024-08-17T02:29:58.745789+0000","last_peered":"2024-08-17T02:29:58.745789+0000","last_clean":"2024-08-17T02:29:58.745789+0000","last_became_active":"2024-08-17T02:29:58.736435+0000","last_became_peered":"2024-08-17T02:29:58.736435+0000","last_unstale":"2024-08-17T02:29:58.745789+0000","last_undegraded":"2024-08-17T02:29:58.745789+0000","last_fullsized":"2024-08-17T02:29:58.745789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712419+0000","last_change":"2024-08-17T02:29:57.721626+0000","last_active":"2024-08-17T02:29:58.712419+0000","last_peered":"2024-08-17T02:29:58.712419+0000","last_clean":"2024-08-17T02:29:58.712419+0000","last_became_active":"2024-08-17T02:29:57.721324+0000","last_became_peered":"2024-08-17T02:29:57.721324+0000","last_unstale":"2024-08-17T02:29:58.712419+0000","last_undegraded":"2024-08-17T02:29:58.712419+0000","last_fullsized":"2024-08-17T02:29:58.712419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738258+0000","last_change":"2024-08-17T02:29:58.735566+0000","last_active":"2024-08-17T02:29:58.738258+0000","last_peered":"2024-08-17T02:29:58.738258+0000","last_clean":"2024-08-17T02:29:58.738258+0000","last_became_active":"2024-08-17T02:29:58.735076+0000","last_became_peered":"2024-08-17T02:29:58.735076+0000","last_unstale":"2024-08-17T02:29:58.738258+0000","last_undegraded":"2024-08-17T02:29:58.738258+0000","last_fullsized":"2024-08-17T02:29:58.738258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:11.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721996+0000","last_change":"2024-08-17T02:29:57.719061+0000","last_active":"2024-08-17T02:29:58.721996+0000","last_peered":"2024-08-17T02:29:58.721996+0000","last_clean":"2024-08-17T02:29:58.721996+0000","last_became_active":"2024-08-17T02:29:57.718710+0000","last_became_peered":"2024-08-17T02:29:57.718710+0000","last_unstale":"2024-08-17T02:29:58.721996+0000","last_undegraded":"2024-08-17T02:29:58.721996+0000","last_fullsized":"2024-08-17T02:29:58.721996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:18.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741483+0000","last_change":"2024-08-17T02:29:58.734533+0000","last_active":"2024-08-17T02:29:58.741483+0000","last_peered":"2024-08-17T02:29:58.741483+0000","last_clean":"2024-08-17T02:29:58.741483+0000","last_became_active":"2024-08-17T02:29:58.733973+0000","last_became_peered":"2024-08-17T02:29:58.733973+0000","last_unstale":"2024-08-17T02:29:58.741483+0000","last_undegraded":"2024-08-17T02:29:58.741483+0000","last_fullsized":"2024-08-17T02:29:58.741483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:09.843119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.718432+0000","last_change":"2024-08-17T02:29:57.729531+0000","last_active":"2024-08-17T02:29:58.718432+0000","last_peered":"2024-08-17T02:29:58.718432+0000","last_clean":"2024-08-17T02:29:58.718432+0000","last_became_active":"2024-08-17T02:29:57.729199+0000","last_became_peered":"2024-08-17T02:29:57.729199+0000","last_unstale":"2024-08-17T02:29:58.718432+0000","last_undegraded":"2024-08-17T02:29:58.718432+0000","last_fullsized":"2024-08-17T02:29:58.718432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:44.243269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745247+0000","last_change":"2024-08-17T02:29:58.741796+0000","last_active":"2024-08-17T02:29:58.745247+0000","last_peered":"2024-08-17T02:29:58.745247+0000","last_clean":"2024-08-17T02:29:58.745247+0000","last_became_active":"2024-08-17T02:29:58.736197+0000","last_became_peered":"2024-08-17T02:29:58.736197+0000","last_unstale":"2024-08-17T02:29:58.745247+0000","last_undegraded":"2024-08-17T02:29:58.745247+0000","last_fullsized":"2024-08-17T02:29:58.745247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724160+0000","last_change":"2024-08-17T02:29:57.726131+0000","last_active":"2024-08-17T02:29:58.724160+0000","last_peered":"2024-08-17T02:29:58.724160+0000","last_clean":"2024-08-17T02:29:58.724160+0000","last_became_active":"2024-08-17T02:29:57.725827+0000","last_became_peered":"2024-08-17T02:29:57.725827+0000","last_unstale":"2024-08-17T02:29:58.724160+0000","last_undegraded":"2024-08-17T02:29:58.724160+0000","last_fullsized":"2024-08-17T02:29:58.724160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.722721+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:58.722721+0000","last_peered":"2024-08-17T02:29:58.722721+0000","last_clean":"2024-08-17T02:29:58.722721+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:58.722721+0000","last_undegraded":"2024-08-17T02:29:58.722721+0000","last_fullsized":"2024-08-17T02:29:58.722721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":966656,"data_stored":732114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":372736,"data_stored":141726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":962560,"data_stored":732024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:07.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:30:07.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.662+0000 7f38cb000640 1 Processor -- start 2024-08-17T02:30:07.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.663+0000 7f38cb000640 1 -- start start 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38c4155900 0x7f38c4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c40b0270 0x7f38c4156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f38c4157b20 0x7f38c4157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c4157690 con 0x7f38c4155900 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c4156a80 con 0x7f38c4157b20 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38cb000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4156d60 con 0x7f38c40b0270 2024-08-17T02:30:07.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38c9c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38c4155900 0x7f38c4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38c9c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38c4155900 0x7f38c4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34956/0 (socket says 172.21.15.110:34956) 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38c9c00640 1 -- 172.21.15.110:0/3414229372 learned_addr learned my addr 172.21.15.110:0/3414229372 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38c9200640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c40b0270 0x7f38c4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.664+0000 7f38ca600640 1 --2- 172.21.15.110:0/3414229372 >> v2:172.21.15.177:3300/0 conn(0x7f38c4157b20 0x7f38c4157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.665+0000 7f38c9c00640 1 -- 172.21.15.110:0/3414229372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c40b0270 msgr2=0x7f38c4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.665+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c40b0270 0x7f38c4156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.665+0000 7f38c9c00640 1 -- 172.21.15.110:0/3414229372 >> v2:172.21.15.177:3300/0 conn(0x7f38c4157b20 msgr2=0x7f38c4157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.665+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3414229372 >> v2:172.21.15.177:3300/0 conn(0x7f38c4157b20 0x7f38c4157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.665+0000 7f38c9c00640 1 -- 172.21.15.110:0/3414229372 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4157040 con 0x7f38c4155900 2024-08-17T02:30:07.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c4155900 0x7f38c4155cd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38c40cc860 tx=0x7f38b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adda33b2e9b0c19 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:07.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38c3e00640 1 -- 172.21.15.110:0/3414229372 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8031510 con 0x7f38c4155900 2024-08-17T02:30:07.667 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38c3e00640 1 -- 172.21.15.110:0/3414229372 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b802f050 con 0x7f38c4155900 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38c3e00640 1 -- 172.21.15.110:0/3414229372 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80318e0 con 0x7f38c4155900 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 -- 172.21.15.110:0/3414229372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c4155900 msgr2=0x7f38c4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c4155900 0x7f38c4155cd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f38c40cc860 tx=0x7f38b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 -- 172.21.15.110:0/3414229372 shutdown_connections 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 --2- 172.21.15.110:0/3414229372 >> v2:172.21.15.177:3300/0 conn(0x7f38c4157b20 0x7f38c4157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c40b0270 0x7f38c4156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 --2- 172.21.15.110:0/3414229372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c4155900 0x7f38c4155cd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.666+0000 7f38cb000640 1 -- 172.21.15.110:0/3414229372 >> 172.21.15.110:0/3414229372 conn(0x7f38c4067750 msgr2=0x7f38c40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.667+0000 7f38cb000640 1 -- 172.21.15.110:0/3414229372 shutdown_connections 2024-08-17T02:30:07.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.667+0000 7f38cb000640 1 -- 172.21.15.110:0/3414229372 wait complete. 2024-08-17T02:30:07.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.668+0000 7f38cb000640 1 Processor -- start 2024-08-17T02:30:07.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.668+0000 7f38cb000640 1 -- start start 2024-08-17T02:30:07.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 0x7f38c4169290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 0x7f38c41697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40a9b10 con 0x7f38c40b0270 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c415b310 con 0x7f38c4155900 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38cb000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c413bee0 con 0x7f38c4157b20 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38c9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38c9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34962/0 (socket says 172.21.15.110:34962) 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38c9c00640 1 -- 172.21.15.110:0/3613258839 learned_addr learned my addr 172.21.15.110:0/3613258839 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38c9200640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 0x7f38c4169290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.669+0000 7f38ca600640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 0x7f38c41697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 -- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 msgr2=0x7f38c41697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 0x7f38c41697d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 -- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 msgr2=0x7f38c4169290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 0x7f38c4169290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 -- 172.21.15.110:0/3613258839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8009450 con 0x7f38c40b0270 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9200640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 0x7f38c4169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38ca600640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 0x7f38c41697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c9c00640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006c70 tx=0x7f38b8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8033960 con 0x7f38c40b0270 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8033ae0 con 0x7f38c40b0270 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b8033ea0 con 0x7f38c40b0270 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c415aa70 con 0x7f38c40b0270 2024-08-17T02:30:07.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.670+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c415b030 con 0x7f38c40b0270 2024-08-17T02:30:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.671+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c40a98e0 con 0x7f38c40b0270 2024-08-17T02:30:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.672+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f38b803d650 con 0x7f38c40b0270 2024-08-17T02:30:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.673+0000 7f38c0c00640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 0x7f38a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:07.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.673+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38b80a3890 con 0x7f38c40b0270 2024-08-17T02:30:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.673+0000 7f38c9200640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 0x7f38a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:07.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.674+0000 7f38c9200640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 0x7f38a4067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38b000bb80 tx=0x7f38b0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:07.678 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.678+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f38c40a98e0 con 0x7f38c40b0270 2024-08-17T02:30:07.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.846+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38c40a98e0 con 0x7f38a4065150 2024-08-17T02:30:07.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.853+0000 7f38c0c00640 1 -- 172.21.15.110:0/3613258839 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+267891 (secure 0 0 0) 0x7f38c40a98e0 con 0x7f38a4065150 2024-08-17T02:30:07.857 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:07.859 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 msgr2=0x7f38a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 0x7f38a4067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f38b000bb80 tx=0x7f38b0008040 comp rx=0 tx=0).stop 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 msgr2=0x7f38c4157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f38b8006c70 tx=0x7f38b8037000 comp rx=0 tx=0).stop 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 shutdown_connections 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f38a4065150 0x7f38a4067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.861 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38c4157b20 0x7f38c41697d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38c4155900 0x7f38c4169290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 --2- 172.21.15.110:0/3613258839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40b0270 0x7f38c4157f80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 >> 172.21.15.110:0/3613258839 conn(0x7f38c4067750 msgr2=0x7f38c40af540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 shutdown_connections 2024-08-17T02:30:07.862 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:07.857+0000 7f38cb000640 1 -- 172.21.15.110:0/3613258839 wait complete. 2024-08-17T02:30:07.872 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-17T02:30:07.448310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399636,"kb_used_data":4104,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575084,"statfs":{"total":773094113280,"available":770636886016,"internally_reserved":0,"allocated":4202496,"data_stored":2318660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.732622"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749314+0000","last_change":"2024-08-17T02:29:58.741643+0000","last_active":"2024-08-17T02:29:58.749314+0000","last_peered":"2024-08-17T02:29:58.749314+0000","last_clean":"2024-08-17T02:29:58.749314+0000","last_became_active":"2024-08-17T02:29:58.739611+0000","last_became_peered":"2024-08-17T02:29:58.739611+0000","last_unstale":"2024-08-17T02:29:58.749314+0000","last_undegraded":"2024-08-17T02:29:58.749314+0000","last_fullsized":"2024-08-17T02:29:58.749314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746988+0000","last_change":"2024-08-17T02:29:58.743692+0000","last_active":"2024-08-17T02:29:58.746988+0000","last_peered":"2024-08-17T02:29:58.746988+0000","last_clean":"2024-08-17T02:29:58.746988+0000","last_became_active":"2024-08-17T02:29:58.741923+0000","last_became_peered":"2024-08-17T02:29:58.741923+0000","last_unstale":"2024-08-17T02:29:58.746988+0000","last_undegraded":"2024-08-17T02:29:58.746988+0000","last_fullsized":"2024-08-17T02:29:58.746988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750639+0000","last_change":"2024-08-17T02:29:58.743429+0000","last_active":"2024-08-17T02:29:58.750639+0000","last_peered":"2024-08-17T02:29:58.750639+0000","last_clean":"2024-08-17T02:29:58.750639+0000","last_became_active":"2024-08-17T02:29:58.742398+0000","last_became_peered":"2024-08-17T02:29:58.742398+0000","last_unstale":"2024-08-17T02:29:58.750639+0000","last_undegraded":"2024-08-17T02:29:58.750639+0000","last_fullsized":"2024-08-17T02:29:58.750639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742741+0000","last_change":"2024-08-17T02:29:58.731783+0000","last_active":"2024-08-17T02:29:58.742741+0000","last_peered":"2024-08-17T02:29:58.742741+0000","last_clean":"2024-08-17T02:29:58.742741+0000","last_became_active":"2024-08-17T02:29:58.731530+0000","last_became_peered":"2024-08-17T02:29:58.731530+0000","last_unstale":"2024-08-17T02:29:58.742741+0000","last_undegraded":"2024-08-17T02:29:58.742741+0000","last_fullsized":"2024-08-17T02:29:58.742741+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.730477+0000","last_change":"2024-08-17T02:29:58.722268+0000","last_active":"2024-08-17T02:29:58.730477+0000","last_peered":"2024-08-17T02:29:58.730477+0000","last_clean":"2024-08-17T02:29:58.730477+0000","last_became_active":"2024-08-17T02:29:58.721951+0000","last_became_peered":"2024-08-17T02:29:58.721951+0000","last_unstale":"2024-08-17T02:29:58.730477+0000","last_undegraded":"2024-08-17T02:29:58.730477+0000","last_fullsized":"2024-08-17T02:29:58.730477+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:26:24.799353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741898+0000","last_change":"2024-08-17T02:29:58.736216+0000","last_active":"2024-08-17T02:29:58.741898+0000","last_peered":"2024-08-17T02:29:58.741898+0000","last_clean":"2024-08-17T02:29:58.741898+0000","last_became_active":"2024-08-17T02:29:58.735535+0000","last_became_peered":"2024-08-17T02:29:58.735535+0000","last_unstale":"2024-08-17T02:29:58.741898+0000","last_undegraded":"2024-08-17T02:29:58.741898+0000","last_fullsized":"2024-08-17T02:29:58.741898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748584+0000","last_change":"2024-08-17T02:29:58.744028+0000","last_active":"2024-08-17T02:29:58.748584+0000","last_peered":"2024-08-17T02:29:58.748584+0000","last_clean":"2024-08-17T02:29:58.748584+0000","last_became_active":"2024-08-17T02:29:58.743403+0000","last_became_peered":"2024-08-17T02:29:58.743403+0000","last_unstale":"2024-08-17T02:29:58.748584+0000","last_undegraded":"2024-08-17T02:29:58.748584+0000","last_fullsized":"2024-08-17T02:29:58.748584+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746871+0000","last_change":"2024-08-17T02:29:58.743182+0000","last_active":"2024-08-17T02:29:58.746871+0000","last_peered":"2024-08-17T02:29:58.746871+0000","last_clean":"2024-08-17T02:29:58.746871+0000","last_became_active":"2024-08-17T02:29:58.742111+0000","last_became_peered":"2024-08-17T02:29:58.742111+0000","last_unstale":"2024-08-17T02:29:58.746871+0000","last_undegraded":"2024-08-17T02:29:58.746871+0000","last_fullsized":"2024-08-17T02:29:58.746871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739442+0000","last_change":"2024-08-17T02:29:58.730907+0000","last_active":"2024-08-17T02:29:58.739442+0000","last_peered":"2024-08-17T02:29:58.739442+0000","last_clean":"2024-08-17T02:29:58.739442+0000","last_became_active":"2024-08-17T02:29:58.727907+0000","last_became_peered":"2024-08-17T02:29:58.727907+0000","last_unstale":"2024-08-17T02:29:58.739442+0000","last_undegraded":"2024-08-17T02:29:58.739442+0000","last_fullsized":"2024-08-17T02:29:58.739442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:53:41.162732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740076+0000","last_change":"2024-08-17T02:29:58.727278+0000","last_active":"2024-08-17T02:29:58.740076+0000","last_peered":"2024-08-17T02:29:58.740076+0000","last_clean":"2024-08-17T02:29:58.740076+0000","last_became_active":"2024-08-17T02:29:58.726951+0000","last_became_peered":"2024-08-17T02:29:58.726951+0000","last_unstale":"2024-08-17T02:29:58.740076+0000","last_undegraded":"2024-08-17T02:29:58.740076+0000","last_fullsized":"2024-08-17T02:29:58.740076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745305+0000","last_change":"2024-08-17T02:29:58.742574+0000","last_active":"2024-08-17T02:29:58.745305+0000","last_peered":"2024-08-17T02:29:58.745305+0000","last_clean":"2024-08-17T02:29:58.745305+0000","last_became_active":"2024-08-17T02:29:58.742198+0000","last_became_peered":"2024-08-17T02:29:58.742198+0000","last_unstale":"2024-08-17T02:29:58.745305+0000","last_undegraded":"2024-08-17T02:29:58.745305+0000","last_fullsized":"2024-08-17T02:29:58.745305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743782+0000","last_change":"2024-08-17T02:29:58.740386+0000","last_active":"2024-08-17T02:29:58.743782+0000","last_peered":"2024-08-17T02:29:58.743782+0000","last_clean":"2024-08-17T02:29:58.743782+0000","last_became_active":"2024-08-17T02:29:58.740099+0000","last_became_peered":"2024-08-17T02:29:58.740099+0000","last_unstale":"2024-08-17T02:29:58.743782+0000","last_undegraded":"2024-08-17T02:29:58.743782+0000","last_fullsized":"2024-08-17T02:29:58.743782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732844+0000","last_change":"2024-08-17T02:29:58.724858+0000","last_active":"2024-08-17T02:29:58.732844+0000","last_peered":"2024-08-17T02:29:58.732844+0000","last_clean":"2024-08-17T02:29:58.732844+0000","last_became_active":"2024-08-17T02:29:58.724544+0000","last_became_peered":"2024-08-17T02:29:58.724544+0000","last_unstale":"2024-08-17T02:29:58.732844+0000","last_undegraded":"2024-08-17T02:29:58.732844+0000","last_fullsized":"2024-08-17T02:29:58.732844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:42.188722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746925+0000","last_change":"2024-08-17T02:29:58.742560+0000","last_active":"2024-08-17T02:29:58.746925+0000","last_peered":"2024-08-17T02:29:58.746925+0000","last_clean":"2024-08-17T02:29:58.746925+0000","last_became_active":"2024-08-17T02:29:58.742283+0000","last_became_peered":"2024-08-17T02:29:58.742283+0000","last_unstale":"2024-08-17T02:29:58.746925+0000","last_undegraded":"2024-08-17T02:29:58.746925+0000","last_fullsized":"2024-08-17T02:29:58.746925+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753162+0000","last_change":"2024-08-17T02:29:58.751517+0000","last_active":"2024-08-17T02:29:58.753162+0000","last_peered":"2024-08-17T02:29:58.753162+0000","last_clean":"2024-08-17T02:29:58.753162+0000","last_became_active":"2024-08-17T02:29:58.750958+0000","last_became_peered":"2024-08-17T02:29:58.750958+0000","last_unstale":"2024-08-17T02:29:58.753162+0000","last_undegraded":"2024-08-17T02:29:58.753162+0000","last_fullsized":"2024-08-17T02:29:58.753162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746926+0000","last_change":"2024-08-17T02:29:58.743516+0000","last_active":"2024-08-17T02:29:58.746926+0000","last_peered":"2024-08-17T02:29:58.746926+0000","last_clean":"2024-08-17T02:29:58.746926+0000","last_became_active":"2024-08-17T02:29:58.742817+0000","last_became_peered":"2024-08-17T02:29:58.742817+0000","last_unstale":"2024-08-17T02:29:58.746926+0000","last_undegraded":"2024-08-17T02:29:58.746926+0000","last_fullsized":"2024-08-17T02:29:58.746926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751410+0000","last_change":"2024-08-17T02:29:58.748884+0000","last_active":"2024-08-17T02:29:58.751410+0000","last_peered":"2024-08-17T02:29:58.751410+0000","last_clean":"2024-08-17T02:29:58.751410+0000","last_became_active":"2024-08-17T02:29:58.746711+0000","last_became_peered":"2024-08-17T02:29:58.746711+0000","last_unstale":"2024-08-17T02:29:58.751410+0000","last_undegraded":"2024-08-17T02:29:58.751410+0000","last_fullsized":"2024-08-17T02:29:58.751410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:09:33.897899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738331+0000","last_change":"2024-08-17T02:29:58.730041+0000","last_active":"2024-08-17T02:29:58.738331+0000","last_peered":"2024-08-17T02:29:58.738331+0000","last_clean":"2024-08-17T02:29:58.738331+0000","last_became_active":"2024-08-17T02:29:58.729760+0000","last_became_peered":"2024-08-17T02:29:58.729760+0000","last_unstale":"2024-08-17T02:29:58.738331+0000","last_undegraded":"2024-08-17T02:29:58.738331+0000","last_fullsized":"2024-08-17T02:29:58.738331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:13:40.726566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744180+0000","last_change":"2024-08-17T02:29:58.741199+0000","last_active":"2024-08-17T02:29:58.744180+0000","last_peered":"2024-08-17T02:29:58.744180+0000","last_clean":"2024-08-17T02:29:58.744180+0000","last_became_active":"2024-08-17T02:29:58.740700+0000","last_became_peered":"2024-08-17T02:29:58.740700+0000","last_unstale":"2024-08-17T02:29:58.744180+0000","last_undegraded":"2024-08-17T02:29:58.744180+0000","last_fullsized":"2024-08-17T02:29:58.744180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739703+0000","last_change":"2024-08-17T02:29:58.736003+0000","last_active":"2024-08-17T02:29:58.739703+0000","last_peered":"2024-08-17T02:29:58.739703+0000","last_clean":"2024-08-17T02:29:58.739703+0000","last_became_active":"2024-08-17T02:29:58.735774+0000","last_became_peered":"2024-08-17T02:29:58.735774+0000","last_unstale":"2024-08-17T02:29:58.739703+0000","last_undegraded":"2024-08-17T02:29:58.739703+0000","last_fullsized":"2024-08-17T02:29:58.739703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:56:42.991665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.731002+0000","last_change":"2024-08-17T02:29:58.723426+0000","last_active":"2024-08-17T02:29:58.731002+0000","last_peered":"2024-08-17T02:29:58.731002+0000","last_clean":"2024-08-17T02:29:58.731002+0000","last_became_active":"2024-08-17T02:29:58.723149+0000","last_became_peered":"2024-08-17T02:29:58.723149+0000","last_unstale":"2024-08-17T02:29:58.731002+0000","last_undegraded":"2024-08-17T02:29:58.731002+0000","last_fullsized":"2024-08-17T02:29:58.731002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:11:10.591085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751621+0000","last_change":"2024-08-17T02:29:58.744330+0000","last_active":"2024-08-17T02:29:58.751621+0000","last_peered":"2024-08-17T02:29:58.751621+0000","last_clean":"2024-08-17T02:29:58.751621+0000","last_became_active":"2024-08-17T02:29:58.744077+0000","last_became_peered":"2024-08-17T02:29:58.744077+0000","last_unstale":"2024-08-17T02:29:58.751621+0000","last_undegraded":"2024-08-17T02:29:58.751621+0000","last_fullsized":"2024-08-17T02:29:58.751621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:55:14.080840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747028+0000","last_change":"2024-08-17T02:29:58.744955+0000","last_active":"2024-08-17T02:29:58.747028+0000","last_peered":"2024-08-17T02:29:58.747028+0000","last_clean":"2024-08-17T02:29:58.747028+0000","last_became_active":"2024-08-17T02:29:58.744686+0000","last_became_peered":"2024-08-17T02:29:58.744686+0000","last_unstale":"2024-08-17T02:29:58.747028+0000","last_undegraded":"2024-08-17T02:29:58.747028+0000","last_fullsized":"2024-08-17T02:29:58.747028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:53.311811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742076+0000","last_change":"2024-08-17T02:29:58.737198+0000","last_active":"2024-08-17T02:29:58.742076+0000","last_peered":"2024-08-17T02:29:58.742076+0000","last_clean":"2024-08-17T02:29:58.742076+0000","last_became_active":"2024-08-17T02:29:58.736888+0000","last_became_peered":"2024-08-17T02:29:58.736888+0000","last_unstale":"2024-08-17T02:29:58.742076+0000","last_undegraded":"2024-08-17T02:29:58.742076+0000","last_fullsized":"2024-08-17T02:29:58.742076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:10:10.936401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743098+0000","last_change":"2024-08-17T02:29:58.734524+0000","last_active":"2024-08-17T02:29:58.743098+0000","last_peered":"2024-08-17T02:29:58.743098+0000","last_clean":"2024-08-17T02:29:58.743098+0000","last_became_active":"2024-08-17T02:29:58.734301+0000","last_became_peered":"2024-08-17T02:29:58.734301+0000","last_unstale":"2024-08-17T02:29:58.743098+0000","last_undegraded":"2024-08-17T02:29:58.743098+0000","last_fullsized":"2024-08-17T02:29:58.743098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:04.992743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741696+0000","last_change":"2024-08-17T02:29:58.740075+0000","last_active":"2024-08-17T02:29:58.741696+0000","last_peered":"2024-08-17T02:29:58.741696+0000","last_clean":"2024-08-17T02:29:58.741696+0000","last_became_active":"2024-08-17T02:29:58.738155+0000","last_became_peered":"2024-08-17T02:29:58.738155+0000","last_unstale":"2024-08-17T02:29:58.741696+0000","last_undegraded":"2024-08-17T02:29:58.741696+0000","last_fullsized":"2024-08-17T02:29:58.741696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:00:30.461064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743326+0000","last_change":"2024-08-17T02:29:58.733055+0000","last_active":"2024-08-17T02:29:58.743326+0000","last_peered":"2024-08-17T02:29:58.743326+0000","last_clean":"2024-08-17T02:29:58.743326+0000","last_became_active":"2024-08-17T02:29:58.732825+0000","last_became_peered":"2024-08-17T02:29:58.732825+0000","last_unstale":"2024-08-17T02:29:58.743326+0000","last_undegraded":"2024-08-17T02:29:58.743326+0000","last_fullsized":"2024-08-17T02:29:58.743326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749674+0000","last_change":"2024-08-17T02:29:58.745816+0000","last_active":"2024-08-17T02:29:58.749674+0000","last_peered":"2024-08-17T02:29:58.749674+0000","last_clean":"2024-08-17T02:29:58.749674+0000","last_became_active":"2024-08-17T02:29:58.745577+0000","last_became_peered":"2024-08-17T02:29:58.745577+0000","last_unstale":"2024-08-17T02:29:58.749674+0000","last_undegraded":"2024-08-17T02:29:58.749674+0000","last_fullsized":"2024-08-17T02:29:58.749674+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:30:34.768760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751986+0000","last_change":"2024-08-17T02:29:58.749463+0000","last_active":"2024-08-17T02:29:58.751986+0000","last_peered":"2024-08-17T02:29:58.751986+0000","last_clean":"2024-08-17T02:29:58.751986+0000","last_became_active":"2024-08-17T02:29:58.747016+0000","last_became_peered":"2024-08-17T02:29:58.747016+0000","last_unstale":"2024-08-17T02:29:58.751986+0000","last_undegraded":"2024-08-17T02:29:58.751986+0000","last_fullsized":"2024-08-17T02:29:58.751986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:44:47.734268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749971+0000","last_change":"2024-08-17T02:29:58.746539+0000","last_active":"2024-08-17T02:29:58.749971+0000","last_peered":"2024-08-17T02:29:58.749971+0000","last_clean":"2024-08-17T02:29:58.749971+0000","last_became_active":"2024-08-17T02:29:58.746229+0000","last_became_peered":"2024-08-17T02:29:58.746229+0000","last_unstale":"2024-08-17T02:29:58.749971+0000","last_undegraded":"2024-08-17T02:29:58.749971+0000","last_fullsized":"2024-08-17T02:29:58.749971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:51.305282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749209+0000","last_change":"2024-08-17T02:29:58.741822+0000","last_active":"2024-08-17T02:29:58.749209+0000","last_peered":"2024-08-17T02:29:58.749209+0000","last_clean":"2024-08-17T02:29:58.749209+0000","last_became_active":"2024-08-17T02:29:58.741389+0000","last_became_peered":"2024-08-17T02:29:58.741389+0000","last_unstale":"2024-08-17T02:29:58.749209+0000","last_undegraded":"2024-08-17T02:29:58.749209+0000","last_fullsized":"2024-08-17T02:29:58.749209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.744371+0000","last_change":"2024-08-17T02:29:58.738700+0000","last_active":"2024-08-17T02:29:58.744371+0000","last_peered":"2024-08-17T02:29:58.744371+0000","last_clean":"2024-08-17T02:29:58.744371+0000","last_became_active":"2024-08-17T02:29:58.738357+0000","last_became_peered":"2024-08-17T02:29:58.738357+0000","last_unstale":"2024-08-17T02:29:58.744371+0000","last_undegraded":"2024-08-17T02:29:58.744371+0000","last_fullsized":"2024-08-17T02:29:58.744371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:12:44.381916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745622+0000","last_change":"2024-08-17T02:29:58.742020+0000","last_active":"2024-08-17T02:29:58.745622+0000","last_peered":"2024-08-17T02:29:58.745622+0000","last_clean":"2024-08-17T02:29:58.745622+0000","last_became_active":"2024-08-17T02:29:58.741761+0000","last_became_peered":"2024-08-17T02:29:58.741761+0000","last_unstale":"2024-08-17T02:29:58.745622+0000","last_undegraded":"2024-08-17T02:29:58.745622+0000","last_fullsized":"2024-08-17T02:29:58.745622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:57.027420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752498+0000","last_change":"2024-08-17T02:29:57.725268+0000","last_active":"2024-08-17T02:29:58.752498+0000","last_peered":"2024-08-17T02:29:58.752498+0000","last_clean":"2024-08-17T02:29:58.752498+0000","last_became_active":"2024-08-17T02:29:57.724838+0000","last_became_peered":"2024-08-17T02:29:57.724838+0000","last_unstale":"2024-08-17T02:29:58.752498+0000","last_undegraded":"2024-08-17T02:29:58.752498+0000","last_fullsized":"2024-08-17T02:29:58.752498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:21.729689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749334+0000","last_change":"2024-08-17T02:29:58.742048+0000","last_active":"2024-08-17T02:29:58.749334+0000","last_peered":"2024-08-17T02:29:58.749334+0000","last_clean":"2024-08-17T02:29:58.749334+0000","last_became_active":"2024-08-17T02:29:58.741776+0000","last_became_peered":"2024-08-17T02:29:58.741776+0000","last_unstale":"2024-08-17T02:29:58.749334+0000","last_undegraded":"2024-08-17T02:29:58.749334+0000","last_fullsized":"2024-08-17T02:29:58.749334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:11.094720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749909+0000","last_change":"2024-08-17T02:29:57.728560+0000","last_active":"2024-08-17T02:29:58.749909+0000","last_peered":"2024-08-17T02:29:58.749909+0000","last_clean":"2024-08-17T02:29:58.749909+0000","last_became_active":"2024-08-17T02:29:57.728348+0000","last_became_peered":"2024-08-17T02:29:57.728348+0000","last_unstale":"2024-08-17T02:29:58.749909+0000","last_undegraded":"2024-08-17T02:29:58.749909+0000","last_fullsized":"2024-08-17T02:29:58.749909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751734+0000","last_change":"2024-08-17T02:29:58.747628+0000","last_active":"2024-08-17T02:29:58.751734+0000","last_peered":"2024-08-17T02:29:58.751734+0000","last_clean":"2024-08-17T02:29:58.751734+0000","last_became_active":"2024-08-17T02:29:58.747337+0000","last_became_peered":"2024-08-17T02:29:58.747337+0000","last_unstale":"2024-08-17T02:29:58.751734+0000","last_undegraded":"2024-08-17T02:29:58.751734+0000","last_fullsized":"2024-08-17T02:29:58.751734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:11:14.428939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748007+0000","last_change":"2024-08-17T02:29:57.717746+0000","last_active":"2024-08-17T02:29:58.748007+0000","last_peered":"2024-08-17T02:29:58.748007+0000","last_clean":"2024-08-17T02:29:58.748007+0000","last_became_active":"2024-08-17T02:29:57.717222+0000","last_became_peered":"2024-08-17T02:29:57.717222+0000","last_unstale":"2024-08-17T02:29:58.748007+0000","last_undegraded":"2024-08-17T02:29:58.748007+0000","last_fullsized":"2024-08-17T02:29:58.748007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:25.979558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:58.730890+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:58.730471+0000","last_became_peered":"2024-08-17T02:29:58.730471+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:27:10.630939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746151+0000","last_change":"2024-08-17T02:29:57.725880+0000","last_active":"2024-08-17T02:29:58.746151+0000","last_peered":"2024-08-17T02:29:58.746151+0000","last_clean":"2024-08-17T02:29:58.746151+0000","last_became_active":"2024-08-17T02:29:57.725454+0000","last_became_peered":"2024-08-17T02:29:57.725454+0000","last_unstale":"2024-08-17T02:29:58.746151+0000","last_undegraded":"2024-08-17T02:29:58.746151+0000","last_fullsized":"2024-08-17T02:29:58.746151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:54:56.890041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745195+0000","last_change":"2024-08-17T02:29:58.741751+0000","last_active":"2024-08-17T02:29:58.745195+0000","last_peered":"2024-08-17T02:29:58.745195+0000","last_clean":"2024-08-17T02:29:58.745195+0000","last_became_active":"2024-08-17T02:29:58.741574+0000","last_became_peered":"2024-08-17T02:29:58.741574+0000","last_unstale":"2024-08-17T02:29:58.745195+0000","last_undegraded":"2024-08-17T02:29:58.745195+0000","last_fullsized":"2024-08-17T02:29:58.745195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:19.340836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745104+0000","last_change":"2024-08-17T02:29:57.719062+0000","last_active":"2024-08-17T02:29:58.745104+0000","last_peered":"2024-08-17T02:29:58.745104+0000","last_clean":"2024-08-17T02:29:58.745104+0000","last_became_active":"2024-08-17T02:29:57.716423+0000","last_became_peered":"2024-08-17T02:29:57.716423+0000","last_unstale":"2024-08-17T02:29:58.745104+0000","last_undegraded":"2024-08-17T02:29:58.745104+0000","last_fullsized":"2024-08-17T02:29:58.745104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:43:52.826206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749705+0000","last_change":"2024-08-17T02:29:58.747561+0000","last_active":"2024-08-17T02:29:58.749705+0000","last_peered":"2024-08-17T02:29:58.749705+0000","last_clean":"2024-08-17T02:29:58.749705+0000","last_became_active":"2024-08-17T02:29:58.747006+0000","last_became_peered":"2024-08-17T02:29:58.747006+0000","last_unstale":"2024-08-17T02:29:58.749705+0000","last_undegraded":"2024-08-17T02:29:58.749705+0000","last_fullsized":"2024-08-17T02:29:58.749705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:45:27.171478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743728+0000","last_change":"2024-08-17T02:29:57.716703+0000","last_active":"2024-08-17T02:29:58.743728+0000","last_peered":"2024-08-17T02:29:58.743728+0000","last_clean":"2024-08-17T02:29:58.743728+0000","last_became_active":"2024-08-17T02:29:57.716398+0000","last_became_peered":"2024-08-17T02:29:57.716398+0000","last_unstale":"2024-08-17T02:29:58.743728+0000","last_undegraded":"2024-08-17T02:29:58.743728+0000","last_fullsized":"2024-08-17T02:29:58.743728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:05:11.190397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741009+0000","last_change":"2024-08-17T02:29:58.736558+0000","last_active":"2024-08-17T02:29:58.741009+0000","last_peered":"2024-08-17T02:29:58.741009+0000","last_clean":"2024-08-17T02:29:58.741009+0000","last_became_active":"2024-08-17T02:29:58.735265+0000","last_became_peered":"2024-08-17T02:29:58.735265+0000","last_unstale":"2024-08-17T02:29:58.741009+0000","last_undegraded":"2024-08-17T02:29:58.741009+0000","last_fullsized":"2024-08-17T02:29:58.741009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:35.180625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717776+0000","last_change":"2024-08-17T02:29:57.717409+0000","last_active":"2024-08-17T02:29:58.717776+0000","last_peered":"2024-08-17T02:29:58.717776+0000","last_clean":"2024-08-17T02:29:58.717776+0000","last_became_active":"2024-08-17T02:29:57.717050+0000","last_became_peered":"2024-08-17T02:29:57.717050+0000","last_unstale":"2024-08-17T02:29:58.717776+0000","last_undegraded":"2024-08-17T02:29:58.717776+0000","last_fullsized":"2024-08-17T02:29:58.717776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:55:56.020938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740003+0000","last_change":"2024-08-17T02:29:58.728203+0000","last_active":"2024-08-17T02:29:58.740003+0000","last_peered":"2024-08-17T02:29:58.740003+0000","last_clean":"2024-08-17T02:29:58.740003+0000","last_became_active":"2024-08-17T02:29:58.727970+0000","last_became_peered":"2024-08-17T02:29:58.727970+0000","last_unstale":"2024-08-17T02:29:58.740003+0000","last_undegraded":"2024-08-17T02:29:58.740003+0000","last_fullsized":"2024-08-17T02:29:58.740003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:29:48.051059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.720768+0000","last_change":"2024-08-17T02:29:57.712754+0000","last_active":"2024-08-17T02:29:58.720768+0000","last_peered":"2024-08-17T02:29:58.720768+0000","last_clean":"2024-08-17T02:29:58.720768+0000","last_became_active":"2024-08-17T02:29:57.712420+0000","last_became_peered":"2024-08-17T02:29:57.712420+0000","last_unstale":"2024-08-17T02:29:58.720768+0000","last_undegraded":"2024-08-17T02:29:58.720768+0000","last_fullsized":"2024-08-17T02:29:58.720768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:23:52.076990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743754+0000","last_change":"2024-08-17T02:29:58.741449+0000","last_active":"2024-08-17T02:29:58.743754+0000","last_peered":"2024-08-17T02:29:58.743754+0000","last_clean":"2024-08-17T02:29:58.743754+0000","last_became_active":"2024-08-17T02:29:58.741064+0000","last_became_peered":"2024-08-17T02:29:58.741064+0000","last_unstale":"2024-08-17T02:29:58.743754+0000","last_undegraded":"2024-08-17T02:29:58.743754+0000","last_fullsized":"2024-08-17T02:29:58.743754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721533+0000","last_change":"2024-08-17T02:29:57.728908+0000","last_active":"2024-08-17T02:29:58.721533+0000","last_peered":"2024-08-17T02:29:58.721533+0000","last_clean":"2024-08-17T02:29:58.721533+0000","last_became_active":"2024-08-17T02:29:57.728140+0000","last_became_peered":"2024-08-17T02:29:57.728140+0000","last_unstale":"2024-08-17T02:29:58.721533+0000","last_undegraded":"2024-08-17T02:29:58.721533+0000","last_fullsized":"2024-08-17T02:29:58.721533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:57:52.305329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748869+0000","last_change":"2024-08-17T02:29:58.747780+0000","last_active":"2024-08-17T02:29:58.748869+0000","last_peered":"2024-08-17T02:29:58.748869+0000","last_clean":"2024-08-17T02:29:58.748869+0000","last_became_active":"2024-08-17T02:29:58.747610+0000","last_became_peered":"2024-08-17T02:29:58.747610+0000","last_unstale":"2024-08-17T02:29:58.748869+0000","last_undegraded":"2024-08-17T02:29:58.748869+0000","last_fullsized":"2024-08-17T02:29:58.748869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:27:58.341084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.723686+0000","last_change":"2024-08-17T02:29:57.716795+0000","last_active":"2024-08-17T02:29:58.723686+0000","last_peered":"2024-08-17T02:29:58.723686+0000","last_clean":"2024-08-17T02:29:58.723686+0000","last_became_active":"2024-08-17T02:29:57.716450+0000","last_became_peered":"2024-08-17T02:29:57.716450+0000","last_unstale":"2024-08-17T02:29:58.723686+0000","last_undegraded":"2024-08-17T02:29:58.723686+0000","last_fullsized":"2024-08-17T02:29:58.723686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.740858+0000","last_change":"2024-08-17T02:29:58.739170+0000","last_active":"2024-08-17T02:29:58.740858+0000","last_peered":"2024-08-17T02:29:58.740858+0000","last_clean":"2024-08-17T02:29:58.740858+0000","last_became_active":"2024-08-17T02:29:58.738402+0000","last_became_peered":"2024-08-17T02:29:58.738402+0000","last_unstale":"2024-08-17T02:29:58.740858+0000","last_undegraded":"2024-08-17T02:29:58.740858+0000","last_fullsized":"2024-08-17T02:29:58.740858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:38:00.940495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743289+0000","last_change":"2024-08-17T02:29:57.728489+0000","last_active":"2024-08-17T02:29:58.743289+0000","last_peered":"2024-08-17T02:29:58.743289+0000","last_clean":"2024-08-17T02:29:58.743289+0000","last_became_active":"2024-08-17T02:29:57.728142+0000","last_became_peered":"2024-08-17T02:29:57.728142+0000","last_unstale":"2024-08-17T02:29:58.743289+0000","last_undegraded":"2024-08-17T02:29:58.743289+0000","last_fullsized":"2024-08-17T02:29:58.743289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750659+0000","last_change":"2024-08-17T02:29:58.743587+0000","last_active":"2024-08-17T02:29:58.750659+0000","last_peered":"2024-08-17T02:29:58.750659+0000","last_clean":"2024-08-17T02:29:58.750659+0000","last_became_active":"2024-08-17T02:29:58.742775+0000","last_became_peered":"2024-08-17T02:29:58.742775+0000","last_unstale":"2024-08-17T02:29:58.750659+0000","last_undegraded":"2024-08-17T02:29:58.750659+0000","last_fullsized":"2024-08-17T02:29:58.750659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.753775+0000","last_change":"2024-08-17T02:29:57.721570+0000","last_active":"2024-08-17T02:29:58.753775+0000","last_peered":"2024-08-17T02:29:58.753775+0000","last_clean":"2024-08-17T02:29:58.753775+0000","last_became_active":"2024-08-17T02:29:57.721294+0000","last_became_peered":"2024-08-17T02:29:57.721294+0000","last_unstale":"2024-08-17T02:29:58.753775+0000","last_undegraded":"2024-08-17T02:29:58.753775+0000","last_fullsized":"2024-08-17T02:29:58.753775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:52.103896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.743390+0000","last_change":"2024-08-17T02:29:58.735104+0000","last_active":"2024-08-17T02:29:58.743390+0000","last_peered":"2024-08-17T02:29:58.743390+0000","last_clean":"2024-08-17T02:29:58.743390+0000","last_became_active":"2024-08-17T02:29:58.733757+0000","last_became_peered":"2024-08-17T02:29:58.733757+0000","last_unstale":"2024-08-17T02:29:58.743390+0000","last_undegraded":"2024-08-17T02:29:58.743390+0000","last_fullsized":"2024-08-17T02:29:58.743390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:30.822073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750467+0000","last_change":"2024-08-17T02:29:57.719687+0000","last_active":"2024-08-17T02:29:58.750467+0000","last_peered":"2024-08-17T02:29:58.750467+0000","last_clean":"2024-08-17T02:29:58.750467+0000","last_became_active":"2024-08-17T02:29:57.719440+0000","last_became_peered":"2024-08-17T02:29:57.719440+0000","last_unstale":"2024-08-17T02:29:58.750467+0000","last_undegraded":"2024-08-17T02:29:58.750467+0000","last_fullsized":"2024-08-17T02:29:58.750467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:24:07.181032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748880+0000","last_change":"2024-08-17T02:29:58.748038+0000","last_active":"2024-08-17T02:29:58.748880+0000","last_peered":"2024-08-17T02:29:58.748880+0000","last_clean":"2024-08-17T02:29:58.748880+0000","last_became_active":"2024-08-17T02:29:58.747877+0000","last_became_peered":"2024-08-17T02:29:58.747877+0000","last_unstale":"2024-08-17T02:29:58.748880+0000","last_undegraded":"2024-08-17T02:29:58.748880+0000","last_fullsized":"2024-08-17T02:29:58.748880+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712308+0000","last_change":"2024-08-17T02:29:57.723447+0000","last_active":"2024-08-17T02:29:58.712308+0000","last_peered":"2024-08-17T02:29:58.712308+0000","last_clean":"2024-08-17T02:29:58.712308+0000","last_became_active":"2024-08-17T02:29:57.723180+0000","last_became_peered":"2024-08-17T02:29:57.723180+0000","last_unstale":"2024-08-17T02:29:58.712308+0000","last_undegraded":"2024-08-17T02:29:58.712308+0000","last_fullsized":"2024-08-17T02:29:58.712308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:23:37.843528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746908+0000","last_change":"2024-08-17T02:29:58.743362+0000","last_active":"2024-08-17T02:29:58.746908+0000","last_peered":"2024-08-17T02:29:58.746908+0000","last_clean":"2024-08-17T02:29:58.746908+0000","last_became_active":"2024-08-17T02:29:58.742468+0000","last_became_peered":"2024-08-17T02:29:58.742468+0000","last_unstale":"2024-08-17T02:29:58.746908+0000","last_undegraded":"2024-08-17T02:29:58.746908+0000","last_fullsized":"2024-08-17T02:29:58.746908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:36:56.232955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.717873+0000","last_change":"2024-08-17T02:29:57.728229+0000","last_active":"2024-08-17T02:29:58.717873+0000","last_peered":"2024-08-17T02:29:58.717873+0000","last_clean":"2024-08-17T02:29:58.717873+0000","last_became_active":"2024-08-17T02:29:57.727932+0000","last_became_peered":"2024-08-17T02:29:57.727932+0000","last_unstale":"2024-08-17T02:29:58.717873+0000","last_undegraded":"2024-08-17T02:29:58.717873+0000","last_fullsized":"2024-08-17T02:29:58.717873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:11:10.088238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.749191+0000","last_change":"2024-08-17T02:29:58.741671+0000","last_active":"2024-08-17T02:29:58.749191+0000","last_peered":"2024-08-17T02:29:58.749191+0000","last_clean":"2024-08-17T02:29:58.749191+0000","last_became_active":"2024-08-17T02:29:58.741045+0000","last_became_peered":"2024-08-17T02:29:58.741045+0000","last_unstale":"2024-08-17T02:29:58.749191+0000","last_undegraded":"2024-08-17T02:29:58.749191+0000","last_fullsized":"2024-08-17T02:29:58.749191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:56:26.986040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751388+0000","last_change":"2024-08-17T02:29:57.719498+0000","last_active":"2024-08-17T02:29:58.751388+0000","last_peered":"2024-08-17T02:29:58.751388+0000","last_clean":"2024-08-17T02:29:58.751388+0000","last_became_active":"2024-08-17T02:29:57.719204+0000","last_became_peered":"2024-08-17T02:29:57.719204+0000","last_unstale":"2024-08-17T02:29:58.751388+0000","last_undegraded":"2024-08-17T02:29:58.751388+0000","last_fullsized":"2024-08-17T02:29:58.751388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:15.868133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741526+0000","last_change":"2024-08-17T02:29:58.735615+0000","last_active":"2024-08-17T02:29:58.741526+0000","last_peered":"2024-08-17T02:29:58.741526+0000","last_clean":"2024-08-17T02:29:58.741526+0000","last_became_active":"2024-08-17T02:29:58.735282+0000","last_became_peered":"2024-08-17T02:29:58.735282+0000","last_unstale":"2024-08-17T02:29:58.741526+0000","last_undegraded":"2024-08-17T02:29:58.741526+0000","last_fullsized":"2024-08-17T02:29:58.741526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:04:57.528270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747001+0000","last_change":"2024-08-17T02:29:57.717880+0000","last_active":"2024-08-17T02:29:58.747001+0000","last_peered":"2024-08-17T02:29:58.747001+0000","last_clean":"2024-08-17T02:29:58.747001+0000","last_became_active":"2024-08-17T02:29:57.717512+0000","last_became_peered":"2024-08-17T02:29:57.717512+0000","last_unstale":"2024-08-17T02:29:58.747001+0000","last_undegraded":"2024-08-17T02:29:58.747001+0000","last_fullsized":"2024-08-17T02:29:58.747001+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752046+0000","last_change":"2024-08-17T02:29:58.750227+0000","last_active":"2024-08-17T02:29:58.752046+0000","last_peered":"2024-08-17T02:29:58.752046+0000","last_clean":"2024-08-17T02:29:58.752046+0000","last_became_active":"2024-08-17T02:29:58.749963+0000","last_became_peered":"2024-08-17T02:29:58.749963+0000","last_unstale":"2024-08-17T02:29:58.752046+0000","last_undegraded":"2024-08-17T02:29:58.752046+0000","last_fullsized":"2024-08-17T02:29:58.752046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:35:26.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.750058+0000","last_change":"2024-08-17T02:29:57.712758+0000","last_active":"2024-08-17T02:29:58.750058+0000","last_peered":"2024-08-17T02:29:58.750058+0000","last_clean":"2024-08-17T02:29:58.750058+0000","last_became_active":"2024-08-17T02:29:57.712427+0000","last_became_peered":"2024-08-17T02:29:57.712427+0000","last_unstale":"2024-08-17T02:29:58.750058+0000","last_undegraded":"2024-08-17T02:29:58.750058+0000","last_fullsized":"2024-08-17T02:29:58.750058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:08:15.716980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.742168+0000","last_change":"2024-08-17T02:29:58.730263+0000","last_active":"2024-08-17T02:29:58.742168+0000","last_peered":"2024-08-17T02:29:58.742168+0000","last_clean":"2024-08-17T02:29:58.742168+0000","last_became_active":"2024-08-17T02:29:58.729958+0000","last_became_peered":"2024-08-17T02:29:58.729958+0000","last_unstale":"2024-08-17T02:29:58.742168+0000","last_undegraded":"2024-08-17T02:29:58.742168+0000","last_fullsized":"2024-08-17T02:29:58.742168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738187+0000","last_change":"2024-08-17T02:29:57.720523+0000","last_active":"2024-08-17T02:29:58.738187+0000","last_peered":"2024-08-17T02:29:58.738187+0000","last_clean":"2024-08-17T02:29:58.738187+0000","last_became_active":"2024-08-17T02:29:57.720285+0000","last_became_peered":"2024-08-17T02:29:57.720285+0000","last_unstale":"2024-08-17T02:29:58.738187+0000","last_undegraded":"2024-08-17T02:29:58.738187+0000","last_fullsized":"2024-08-17T02:29:58.738187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:28:03.855557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.746682+0000","last_change":"2024-08-17T02:29:58.741472+0000","last_active":"2024-08-17T02:29:58.746682+0000","last_peered":"2024-08-17T02:29:58.746682+0000","last_clean":"2024-08-17T02:29:58.746682+0000","last_became_active":"2024-08-17T02:29:58.741210+0000","last_became_peered":"2024-08-17T02:29:58.741210+0000","last_unstale":"2024-08-17T02:29:58.746682+0000","last_undegraded":"2024-08-17T02:29:58.746682+0000","last_fullsized":"2024-08-17T02:29:58.746682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:11:22.736171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.725302+0000","last_change":"2024-08-17T02:29:57.717827+0000","last_active":"2024-08-17T02:29:58.725302+0000","last_peered":"2024-08-17T02:29:58.725302+0000","last_clean":"2024-08-17T02:29:58.725302+0000","last_became_active":"2024-08-17T02:29:57.716787+0000","last_became_peered":"2024-08-17T02:29:57.716787+0000","last_unstale":"2024-08-17T02:29:58.725302+0000","last_undegraded":"2024-08-17T02:29:58.725302+0000","last_fullsized":"2024-08-17T02:29:58.725302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:23.126977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.733452+0000","last_change":"2024-08-17T02:29:58.732424+0000","last_active":"2024-08-17T02:29:58.733452+0000","last_peered":"2024-08-17T02:29:58.733452+0000","last_clean":"2024-08-17T02:29:58.733452+0000","last_became_active":"2024-08-17T02:29:58.732155+0000","last_became_peered":"2024-08-17T02:29:58.732155+0000","last_unstale":"2024-08-17T02:29:58.733452+0000","last_undegraded":"2024-08-17T02:29:58.733452+0000","last_fullsized":"2024-08-17T02:29:58.733452+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:34:49.295779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.747704+0000","last_change":"2024-08-17T02:29:57.720005+0000","last_active":"2024-08-17T02:29:58.747704+0000","last_peered":"2024-08-17T02:29:58.747704+0000","last_clean":"2024-08-17T02:29:58.747704+0000","last_became_active":"2024-08-17T02:29:57.719755+0000","last_became_peered":"2024-08-17T02:29:57.719755+0000","last_unstale":"2024-08-17T02:29:58.747704+0000","last_undegraded":"2024-08-17T02:29:58.747704+0000","last_fullsized":"2024-08-17T02:29:58.747704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:44:14.303106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.732864+0000","last_change":"2024-08-17T02:29:58.724971+0000","last_active":"2024-08-17T02:29:58.732864+0000","last_peered":"2024-08-17T02:29:58.732864+0000","last_clean":"2024-08-17T02:29:58.732864+0000","last_became_active":"2024-08-17T02:29:58.722256+0000","last_became_peered":"2024-08-17T02:29:58.722256+0000","last_unstale":"2024-08-17T02:29:58.732864+0000","last_undegraded":"2024-08-17T02:29:58.732864+0000","last_fullsized":"2024-08-17T02:29:58.732864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:09:43.541931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724915+0000","last_change":"2024-08-17T02:29:57.725898+0000","last_active":"2024-08-17T02:29:58.724915+0000","last_peered":"2024-08-17T02:29:58.724915+0000","last_clean":"2024-08-17T02:29:58.724915+0000","last_became_active":"2024-08-17T02:29:57.725628+0000","last_became_peered":"2024-08-17T02:29:57.725628+0000","last_unstale":"2024-08-17T02:29:58.724915+0000","last_undegraded":"2024-08-17T02:29:58.724915+0000","last_fullsized":"2024-08-17T02:29:58.724915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:31.634446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.735480+0000","last_change":"2024-08-17T02:29:58.724432+0000","last_active":"2024-08-17T02:29:58.735480+0000","last_peered":"2024-08-17T02:29:58.735480+0000","last_clean":"2024-08-17T02:29:58.735480+0000","last_became_active":"2024-08-17T02:29:58.724186+0000","last_became_peered":"2024-08-17T02:29:58.724186+0000","last_unstale":"2024-08-17T02:29:58.735480+0000","last_undegraded":"2024-08-17T02:29:58.735480+0000","last_fullsized":"2024-08-17T02:29:58.735480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:30:34.733592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721339+0000","last_change":"2024-08-17T02:29:57.717344+0000","last_active":"2024-08-17T02:29:58.721339+0000","last_peered":"2024-08-17T02:29:58.721339+0000","last_clean":"2024-08-17T02:29:58.721339+0000","last_became_active":"2024-08-17T02:29:57.717079+0000","last_became_peered":"2024-08-17T02:29:57.717079+0000","last_unstale":"2024-08-17T02:29:58.721339+0000","last_undegraded":"2024-08-17T02:29:58.721339+0000","last_fullsized":"2024-08-17T02:29:58.721339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:05:45.092703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748608+0000","last_change":"2024-08-17T02:29:58.744207+0000","last_active":"2024-08-17T02:29:58.748608+0000","last_peered":"2024-08-17T02:29:58.748608+0000","last_clean":"2024-08-17T02:29:58.748608+0000","last_became_active":"2024-08-17T02:29:58.743759+0000","last_became_peered":"2024-08-17T02:29:58.743759+0000","last_unstale":"2024-08-17T02:29:58.748608+0000","last_undegraded":"2024-08-17T02:29:58.748608+0000","last_fullsized":"2024-08-17T02:29:58.748608+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:34:52.236593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.726918+0000","last_change":"2024-08-17T02:29:57.730963+0000","last_active":"2024-08-17T02:29:58.726918+0000","last_peered":"2024-08-17T02:29:58.726918+0000","last_clean":"2024-08-17T02:29:58.726918+0000","last_became_active":"2024-08-17T02:29:57.730724+0000","last_became_peered":"2024-08-17T02:29:57.730724+0000","last_unstale":"2024-08-17T02:29:58.726918+0000","last_undegraded":"2024-08-17T02:29:58.726918+0000","last_fullsized":"2024-08-17T02:29:58.726918+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:42.644489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.739575+0000","last_change":"2024-08-17T02:29:58.737024+0000","last_active":"2024-08-17T02:29:58.739575+0000","last_peered":"2024-08-17T02:29:58.739575+0000","last_clean":"2024-08-17T02:29:58.739575+0000","last_became_active":"2024-08-17T02:29:58.736783+0000","last_became_peered":"2024-08-17T02:29:58.736783+0000","last_unstale":"2024-08-17T02:29:58.739575+0000","last_undegraded":"2024-08-17T02:29:58.739575+0000","last_fullsized":"2024-08-17T02:29:58.739575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:32.640928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.751449+0000","last_change":"2024-08-17T02:29:57.721050+0000","last_active":"2024-08-17T02:29:58.751449+0000","last_peered":"2024-08-17T02:29:58.751449+0000","last_clean":"2024-08-17T02:29:58.751449+0000","last_became_active":"2024-08-17T02:29:57.720746+0000","last_became_peered":"2024-08-17T02:29:57.720746+0000","last_unstale":"2024-08-17T02:29:58.751449+0000","last_undegraded":"2024-08-17T02:29:58.751449+0000","last_fullsized":"2024-08-17T02:29:58.751449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.752028+0000","last_change":"2024-08-17T02:29:58.750144+0000","last_active":"2024-08-17T02:29:58.752028+0000","last_peered":"2024-08-17T02:29:58.752028+0000","last_clean":"2024-08-17T02:29:58.752028+0000","last_became_active":"2024-08-17T02:29:58.749895+0000","last_became_peered":"2024-08-17T02:29:58.749895+0000","last_unstale":"2024-08-17T02:29:58.752028+0000","last_undegraded":"2024-08-17T02:29:58.752028+0000","last_fullsized":"2024-08-17T02:29:58.752028+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-08-17T02:30:00.074040+0000","last_change":"2024-08-17T02:29:57.723014+0000","last_active":"2024-08-17T02:30:00.074040+0000","last_peered":"2024-08-17T02:30:00.074040+0000","last_clean":"2024-08-17T02:30:00.074040+0000","last_became_active":"2024-08-17T02:29:57.722592+0000","last_became_peered":"2024-08-17T02:29:57.722592+0000","last_unstale":"2024-08-17T02:30:00.074040+0000","last_undegraded":"2024-08-17T02:30:00.074040+0000","last_fullsized":"2024-08-17T02:30:00.074040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:55:13.247167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745746+0000","last_change":"2024-08-17T02:29:58.733329+0000","last_active":"2024-08-17T02:29:58.745746+0000","last_peered":"2024-08-17T02:29:58.745746+0000","last_clean":"2024-08-17T02:29:58.745746+0000","last_became_active":"2024-08-17T02:29:58.733024+0000","last_became_peered":"2024-08-17T02:29:58.733024+0000","last_unstale":"2024-08-17T02:29:58.745746+0000","last_undegraded":"2024-08-17T02:29:58.745746+0000","last_fullsized":"2024-08-17T02:29:58.745746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:04:16.874615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.713219+0000","last_change":"2024-08-17T02:29:57.717139+0000","last_active":"2024-08-17T02:29:58.713219+0000","last_peered":"2024-08-17T02:29:58.713219+0000","last_clean":"2024-08-17T02:29:58.713219+0000","last_became_active":"2024-08-17T02:29:57.716871+0000","last_became_peered":"2024-08-17T02:29:57.716871+0000","last_unstale":"2024-08-17T02:29:58.713219+0000","last_undegraded":"2024-08-17T02:29:58.713219+0000","last_fullsized":"2024-08-17T02:29:58.713219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:34:05.009968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.748826+0000","last_change":"2024-08-17T02:29:58.738374+0000","last_active":"2024-08-17T02:29:58.748826+0000","last_peered":"2024-08-17T02:29:58.748826+0000","last_clean":"2024-08-17T02:29:58.748826+0000","last_became_active":"2024-08-17T02:29:58.735086+0000","last_became_peered":"2024-08-17T02:29:58.735086+0000","last_unstale":"2024-08-17T02:29:58.748826+0000","last_undegraded":"2024-08-17T02:29:58.748826+0000","last_fullsized":"2024-08-17T02:29:58.748826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:32:53.110378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724533+0000","last_change":"2024-08-17T02:29:57.718504+0000","last_active":"2024-08-17T02:29:58.724533+0000","last_peered":"2024-08-17T02:29:58.724533+0000","last_clean":"2024-08-17T02:29:58.724533+0000","last_became_active":"2024-08-17T02:29:57.717867+0000","last_became_peered":"2024-08-17T02:29:57.717867+0000","last_unstale":"2024-08-17T02:29:58.724533+0000","last_undegraded":"2024-08-17T02:29:58.724533+0000","last_fullsized":"2024-08-17T02:29:58.724533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745789+0000","last_change":"2024-08-17T02:29:58.736680+0000","last_active":"2024-08-17T02:29:58.745789+0000","last_peered":"2024-08-17T02:29:58.745789+0000","last_clean":"2024-08-17T02:29:58.745789+0000","last_became_active":"2024-08-17T02:29:58.736435+0000","last_became_peered":"2024-08-17T02:29:58.736435+0000","last_unstale":"2024-08-17T02:29:58.745789+0000","last_undegraded":"2024-08-17T02:29:58.745789+0000","last_fullsized":"2024-08-17T02:29:58.745789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:45.249751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.712419+0000","last_change":"2024-08-17T02:29:57.721626+0000","last_active":"2024-08-17T02:29:58.712419+0000","last_peered":"2024-08-17T02:29:58.712419+0000","last_clean":"2024-08-17T02:29:58.712419+0000","last_became_active":"2024-08-17T02:29:57.721324+0000","last_became_peered":"2024-08-17T02:29:57.721324+0000","last_unstale":"2024-08-17T02:29:58.712419+0000","last_undegraded":"2024-08-17T02:29:58.712419+0000","last_fullsized":"2024-08-17T02:29:58.712419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:07:35.844390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.738258+0000","last_change":"2024-08-17T02:29:58.735566+0000","last_active":"2024-08-17T02:29:58.738258+0000","last_peered":"2024-08-17T02:29:58.738258+0000","last_clean":"2024-08-17T02:29:58.738258+0000","last_became_active":"2024-08-17T02:29:58.735076+0000","last_became_peered":"2024-08-17T02:29:58.735076+0000","last_unstale":"2024-08-17T02:29:58.738258+0000","last_undegraded":"2024-08-17T02:29:58.738258+0000","last_fullsized":"2024-08-17T02:29:58.738258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:54:11.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.721996+0000","last_change":"2024-08-17T02:29:57.719061+0000","last_active":"2024-08-17T02:29:58.721996+0000","last_peered":"2024-08-17T02:29:58.721996+0000","last_clean":"2024-08-17T02:29:58.721996+0000","last_became_active":"2024-08-17T02:29:57.718710+0000","last_became_peered":"2024-08-17T02:29:57.718710+0000","last_unstale":"2024-08-17T02:29:58.721996+0000","last_undegraded":"2024-08-17T02:29:58.721996+0000","last_fullsized":"2024-08-17T02:29:58.721996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:37:18.856661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.741483+0000","last_change":"2024-08-17T02:29:58.734533+0000","last_active":"2024-08-17T02:29:58.741483+0000","last_peered":"2024-08-17T02:29:58.741483+0000","last_clean":"2024-08-17T02:29:58.741483+0000","last_became_active":"2024-08-17T02:29:58.733973+0000","last_became_peered":"2024-08-17T02:29:58.733973+0000","last_unstale":"2024-08-17T02:29:58.741483+0000","last_undegraded":"2024-08-17T02:29:58.741483+0000","last_fullsized":"2024-08-17T02:29:58.741483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:04:09.843119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.718432+0000","last_change":"2024-08-17T02:29:57.729531+0000","last_active":"2024-08-17T02:29:58.718432+0000","last_peered":"2024-08-17T02:29:58.718432+0000","last_clean":"2024-08-17T02:29:58.718432+0000","last_became_active":"2024-08-17T02:29:57.729199+0000","last_became_peered":"2024-08-17T02:29:57.729199+0000","last_unstale":"2024-08-17T02:29:58.718432+0000","last_undegraded":"2024-08-17T02:29:58.718432+0000","last_fullsized":"2024-08-17T02:29:58.718432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:38:44.243269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.745247+0000","last_change":"2024-08-17T02:29:58.741796+0000","last_active":"2024-08-17T02:29:58.745247+0000","last_peered":"2024-08-17T02:29:58.745247+0000","last_clean":"2024-08-17T02:29:58.745247+0000","last_became_active":"2024-08-17T02:29:58.736197+0000","last_became_peered":"2024-08-17T02:29:58.736197+0000","last_unstale":"2024-08-17T02:29:58.745247+0000","last_undegraded":"2024-08-17T02:29:58.745247+0000","last_fullsized":"2024-08-17T02:29:58.745247+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:57.695090+0000","last_clean_scrub_stamp":"2024-08-17T02:29:57.695090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:24:16.359464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.724160+0000","last_change":"2024-08-17T02:29:57.726131+0000","last_active":"2024-08-17T02:29:58.724160+0000","last_peered":"2024-08-17T02:29:58.724160+0000","last_clean":"2024-08-17T02:29:58.724160+0000","last_became_active":"2024-08-17T02:29:57.725827+0000","last_became_peered":"2024-08-17T02:29:57.725827+0000","last_unstale":"2024-08-17T02:29:58.724160+0000","last_undegraded":"2024-08-17T02:29:58.724160+0000","last_fullsized":"2024-08-17T02:29:58.724160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:56.688608+0000","last_clean_scrub_stamp":"2024-08-17T02:29:56.688608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:06:41.182240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-08-17T02:29:58.722721+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:29:58.722721+0000","last_peered":"2024-08-17T02:29:58.722721+0000","last_clean":"2024-08-17T02:29:58.722721+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:29:58.722721+0000","last_undegraded":"2024-08-17T02:29:58.722721+0000","last_fullsized":"2024-08-17T02:29:58.722721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":966656,"data_stored":732114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297732,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074108,"statfs":{"total":96636764160,"available":96331886592,"internally_reserved":0,"allocated":376832,"data_stored":142316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":376832,"data_stored":141760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301888,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069952,"statfs":{"total":96636764160,"available":96327630848,"internally_reserved":0,"allocated":372736,"data_stored":141726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301900,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069940,"statfs":{"total":96636764160,"available":96327618560,"internally_reserved":0,"allocated":385024,"data_stored":143230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":0,"up_from":14,"seq":60129542158,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302456,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069384,"statfs":{"total":96636764160,"available":96327049216,"internally_reserved":0,"allocated":962560,"data_stored":732024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.35899999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.56799999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:30:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:30:07.877 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:30:07.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:30:08.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.065+0000 7fc16d600640 1 Processor -- start 2024-08-17T02:30:08.065 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.065+0000 7fc16d600640 1 -- start start 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc16d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc16806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc16d600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1681568b0 con 0x7fc16806e420 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc16d600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc168150500 con 0x7fc168150130 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc16d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16806e8a0 con 0x7fc168156d40 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc167400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc16806e420 0x7fc1680ab510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37728/0 (socket says 172.21.15.110:37728) 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.066+0000 7fc167400640 1 -- 172.21.15.110:0/1908537870 learned_addr learned my addr 172.21.15.110:0/1908537870 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc15e000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc16806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836898649 0 0) 0x7fc1681568b0 con 0x7fc16806e420 2024-08-17T02:30:08.067 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc14c0034e0 con 0x7fc16806e420 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788999627 0 0) 0x7fc168150500 con 0x7fc168150130 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1681568b0 con 0x7fc168150130 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1346153845 0 0) 0x7fc14c0034e0 con 0x7fc16806e420 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 msgr2=0x7fc16806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc16806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 >> v1:172.21.15.177:6789/0 conn(0x7fc168150130 legacy=0x7fc1680aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168155fc0 con 0x7fc16806e420 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fc1600017f0 con 0x7fc16806e420 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 >> v1:172.21.15.110:6789/0 conn(0x7fc16806e420 legacy=0x7fc1680ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c003b90 0x7fc14c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc14c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14c004cc0 0x7fc14c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16806e8a0 con 0x7fc14c003b90 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c00bab0 con 0x7fc14c004cc0 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c00bc70 con 0x7fc168156d40 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.067+0000 7fc166a00640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c003b90 0x7fc14c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc167400640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14c004cc0 0x7fc14c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc15e000640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc14c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc166a00640 1 -- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 msgr2=0x7fc14c004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc166a00640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc168156d40 0x7fc14c004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc166a00640 1 -- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14c004cc0 msgr2=0x7fc14c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc166a00640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc14c004cc0 0x7fc14c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.068+0000 7fc166a00640 1 -- 172.21.15.110:0/1908537870 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0034e0 con 0x7fc14c003b90 2024-08-17T02:30:08.071 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.069+0000 7fc166a00640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c003b90 0x7fc14c003f60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc158001050 tx=0x7fc158007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80eae51df726a2ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.069+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15802aac0 con 0x7fc14c003b90 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.069+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15802ac40 con 0x7fc14c003b90 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.069+0000 7fc166000640 1 -- 172.21.15.110:0/1908537870 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580323f0 con 0x7fc14c003b90 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 -- 172.21.15.110:0/1908537870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c003b90 msgr2=0x7fc14c003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 --2- 172.21.15.110:0/1908537870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c003b90 0x7fc14c003f60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc158001050 tx=0x7fc158007ca0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc167400640 1 -- 172.21.15.110:0/1908537870 reap_dead start 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 -- 172.21.15.110:0/1908537870 shutdown_connections 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 -- 172.21.15.110:0/1908537870 >> 172.21.15.110:0/1908537870 conn(0x7fc168067750 msgr2=0x7fc16806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 -- 172.21.15.110:0/1908537870 shutdown_connections 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.070+0000 7fc16d600640 1 -- 172.21.15.110:0/1908537870 wait complete. 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.071+0000 7fc16d600640 1 Processor -- start 2024-08-17T02:30:08.072 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.071+0000 7fc16d600640 1 -- start start 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc14c003b90 0x7fc16813e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 0x7fc168153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680a9720 con 0x7fc1680a8d70 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc168154630 con 0x7fc1681538c0 2024-08-17T02:30:08.074 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc16d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc168154910 con 0x7fc14c003b90 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc15e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc15e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34988/0 (socket says 172.21.15.110:34988) 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc15e000640 1 -- 172.21.15.110:0/4114485209 learned_addr learned my addr 172.21.15.110:0/4114485209 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc166a00640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc14c003b90 0x7fc16813e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.072+0000 7fc167400640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 0x7fc168153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 -- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc14c003b90 msgr2=0x7fc16813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc14c003b90 0x7fc16813e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 -- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 msgr2=0x7fc168153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 0x7fc168153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 -- 172.21.15.110:0/4114485209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168154bf0 con 0x7fc1680a8d70 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc167400640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 0x7fc168153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15e000640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc150011b40 tx=0x7fc1500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000fb00 con 0x7fc1680a8d70 2024-08-17T02:30:08.075 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000fc60 con 0x7fc1680a8d70 2024-08-17T02:30:08.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc168154ed0 con 0x7fc1680a8d70 2024-08-17T02:30:08.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc150014440 con 0x7fc1680a8d70 2024-08-17T02:30:08.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.073+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc168154270 con 0x7fc1680a8d70 2024-08-17T02:30:08.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.075+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1680710c0 con 0x7fc1680a8d70 2024-08-17T02:30:08.076 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.076+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc1500147b0 con 0x7fc1680a8d70 2024-08-17T02:30:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.076+0000 7fc15ea00640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 0x7fc144067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.076+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc150018030 con 0x7fc1680a8d70 2024-08-17T02:30:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.077+0000 7fc166a00640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 0x7fc144067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.077 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.077+0000 7fc166a00640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 0x7fc144067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc158032000 tx=0x7fc158003000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.081 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.080+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc150051000 con 0x7fc1680a8d70 2024-08-17T02:30:08.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.315+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc16806c7a0 con 0x7fc1680a8d70 2024-08-17T02:30:08.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.319+0000 7fc15ea00640 1 -- 172.21.15.110:0/4114485209 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc1500220e0 con 0x7fc1680a8d70 2024-08-17T02:30:08.319 INFO:teuthology.orchestra.run.smithi110.stderr:updated caps for client.0 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 msgr2=0x7fc144067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 0x7fc144067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc158032000 tx=0x7fc158003000 comp rx=0 tx=0).stop 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 msgr2=0x7fc1680a91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc150011b40 tx=0x7fc1500090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 shutdown_connections 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc144065150 0x7fc144067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1681538c0 0x7fc168153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680a8d70 0x7fc1680a91e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 --2- 172.21.15.110:0/4114485209 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc14c003b90 0x7fc16813e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 >> 172.21.15.110:0/4114485209 conn(0x7fc168067750 msgr2=0x7fc1680ab510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:08.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 shutdown_connections 2024-08-17T02:30:08.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.321+0000 7fc16d600640 1 -- 172.21.15.110:0/4114485209 wait complete. 2024-08-17T02:30:08.337 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:30:08.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.483+0000 7f2e39a00640 1 Processor -- start 2024-08-17T02:30:08.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.483+0000 7f2e39a00640 1 -- start start 2024-08-17T02:30:08.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.484+0000 7f2e39a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 0x7f2e340c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.484+0000 7f2e39a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e340d08d0 0x7f2e341590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.484+0000 7f2e39a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e340cb7c0 con 0x7f2e340cac30 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.484+0000 7f2e39a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e340cf0c0 con 0x7f2e340d08d0 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.484+0000 7f2e39a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34089000 con 0x7f2e34158ce0 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e33400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2e340cac30 0x7f2e340cb0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37732/0 (socket says 172.21.15.110:37732) 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e33400640 1 -- 172.21.15.110:0/1651359017 learned_addr learned my addr 172.21.15.110:0/1651359017 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32000640 1 --2- 172.21.15.110:0/1651359017 >> v2:172.21.15.177:3300/0 conn(0x7f2e340d08d0 0x7f2e341590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32a00640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 0x7f2e340c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e31600640 1 -- 172.21.15.110:0/1651359017 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274556309 0 0) 0x7f2e340cb7c0 con 0x7f2e340cac30 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e31600640 1 -- 172.21.15.110:0/1651359017 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e180034e0 con 0x7f2e340cac30 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32000640 1 -- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 msgr2=0x7f2e340c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32000640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 0x7f2e340c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32000640 1 -- 172.21.15.110:0/1651359017 >> v1:172.21.15.110:6789/0 conn(0x7f2e340cac30 legacy=0x7f2e340cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32000640 1 -- 172.21.15.110:0/1651359017 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340ceb20 con 0x7f2e340d08d0 2024-08-17T02:30:08.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.485+0000 7f2e32a00640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 0x7f2e340c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:08.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.486+0000 7f2e32000640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e340d08d0 0x7f2e341590b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009880 tx=0x7f2e200090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8f61ab126cffad9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e31600640 1 -- 172.21.15.110:0/1651359017 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2002ad90 con 0x7f2e340d08d0 2024-08-17T02:30:08.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e31600640 1 -- 172.21.15.110:0/1651359017 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20032440 con 0x7f2e340d08d0 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e31600640 1 -- 172.21.15.110:0/1651359017 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20032820 con 0x7f2e340d08d0 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 -- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e340d08d0 msgr2=0x7f2e341590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e340d08d0 0x7f2e341590b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009880 tx=0x7f2e200090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 -- 172.21.15.110:0/1651359017 shutdown_connections 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e340d08d0 0x7f2e341590b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 --2- 172.21.15.110:0/1651359017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e34158ce0 0x7f2e340c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 -- 172.21.15.110:0/1651359017 >> 172.21.15.110:0/1651359017 conn(0x7f2e340cfdc0 msgr2=0x7f2e340d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 -- 172.21.15.110:0/1651359017 shutdown_connections 2024-08-17T02:30:08.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.487+0000 7f2e39a00640 1 -- 172.21.15.110:0/1651359017 wait complete. 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.489+0000 7f2e39a00640 1 Processor -- start 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.489+0000 7f2e39a00640 1 -- start start 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 0x7f2e341699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 0x7f2e3416b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34156ff0 con 0x7f2e340d08d0 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34151360 con 0x7f2e34158ce0 2024-08-17T02:30:08.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e39a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34156670 con 0x7f2e340cac30 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35002/0 (socket says 172.21.15.110:35002) 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 -- 172.21.15.110:0/571578470 learned_addr learned my addr 172.21.15.110:0/571578470 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 0x7f2e341699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e33400640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 0x7f2e3416b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 -- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 msgr2=0x7f2e341699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 0x7f2e341699d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 -- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 msgr2=0x7f2e3416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 0x7f2e3416b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32000640 1 -- 172.21.15.110:0/571578470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e24009390 con 0x7f2e340d08d0 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e32a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 0x7f2e341699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.490+0000 7f2e33400640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 0x7f2e3416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:30:08.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e32000640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009360 tx=0x7f2e20032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e20031c20 con 0x7f2e340d08d0 2024-08-17T02:30:08.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20031da0 con 0x7f2e340d08d0 2024-08-17T02:30:08.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e20009390 con 0x7f2e340d08d0 2024-08-17T02:30:08.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2003d670 con 0x7f2e340d08d0 2024-08-17T02:30:08.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.491+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e34156930 con 0x7f2e340d08d0 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.492+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34064db0 con 0x7f2e340d08d0 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.493+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e20039040 con 0x7f2e340d08d0 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.494+0000 7f2e2a000640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 0x7f2e14067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.494+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e200a2620 con 0x7f2e340d08d0 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.494+0000 7f2e32a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 0x7f2e14067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:08.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.495+0000 7f2e32a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 0x7f2e14067680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009360 tx=0x7f2e24008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:08.498 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.498+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e20070640 con 0x7f2e340d08d0 2024-08-17T02:30:08.704 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.704+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e34169f10 con 0x7f2e340d08d0 2024-08-17T02:30:08.705 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.705+0000 7f2e2a000640 1 -- 172.21.15.110:0/571578470 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f2e20073c60 con 0x7f2e340d08d0 2024-08-17T02:30:08.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:08.705 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4903,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:30:08.706 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 17 2024-08-17T02:30:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 msgr2=0x7f2e14067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.707 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 0x7f2e14067680 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2e24009360 tx=0x7f2e24008040 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 msgr2=0x7f2e340b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009360 tx=0x7f2e20032000 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 shutdown_connections 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e140651d0 0x7f2e14067680 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e34158ce0 0x7f2e3416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e340d08d0 0x7f2e340b3500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 --2- 172.21.15.110:0/571578470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e340cac30 0x7f2e341699d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 >> 172.21.15.110:0/571578470 conn(0x7f2e340cfdc0 msgr2=0x7f2e340cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 shutdown_connections 2024-08-17T02:30:08.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:08.707+0000 7f2e39a00640 1 -- 172.21.15.110:0/571578470 wait complete. 2024-08-17T02:30:09.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:29:58.116053+0000', 'modified': '2024-08-17T02:30:01.735236+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4920}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4920': {'gid': 4920, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/3374805694', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6834', 'nonce': 3374805694}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 3374805694}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:30:09.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:30:09.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-17T02:30:09.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.275+0000 7fd400000640 1 Processor -- start 2024-08-17T02:30:09.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.275+0000 7fd400000640 1 -- start start 2024-08-17T02:30:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.276+0000 7fd400000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd3f806df00 0x7fd3f80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.276+0000 7fd400000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.276+0000 7fd400000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3f8156670 con 0x7fd3f8155a20 2024-08-17T02:30:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.276+0000 7fd400000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3f80b0350 con 0x7fd3f806df00 2024-08-17T02:30:09.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.276+0000 7fd400000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f806e5e0 con 0x7fd3f8155df0 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fcc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd3f806df00 0x7fd3f80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:48510/0 (socket says 172.21.15.110:48510) 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 -- 172.21.15.110:0/2425787966 learned_addr learned my addr 172.21.15.110:0/2425787966 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fd600640 1 --1- 172.21.15.110:0/2425787966 >> v1:172.21.15.177:6789/0 conn(0x7fd3f8155a20 0x7fd3f806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:40542/0 (socket says 172.21.15.110:40542) 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 -- 172.21.15.110:0/2425787966 >> v2:172.21.15.177:3300/0 conn(0x7fd3f806df00 msgr2=0x7fd3f80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 --2- 172.21.15.110:0/2425787966 >> v2:172.21.15.177:3300/0 conn(0x7fd3f806df00 0x7fd3f80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.278 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3fe000640 1 -- 172.21.15.110:0/2425787966 >> v1:172.21.15.177:6789/0 conn(0x7fd3f8155a20 legacy=0x7fd3f806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.277+0000 7fd3f7e00640 1 -- 172.21.15.110:0/2425787966 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282843687 0 0) 0x7fd3f8156670 con 0x7fd3f8155a20 2024-08-17T02:30:09.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.278+0000 7fd3fe000640 1 -- 172.21.15.110:0/2425787966 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f806e8c0 con 0x7fd3f8155df0 2024-08-17T02:30:09.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.279+0000 7fd3fe000640 1 --2- 172.21.15.110:0/2425787966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f20 tx=0x7fd3f0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=211f61b822140c76 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.279+0000 7fd3f7e00640 1 -- 172.21.15.110:0/2425787966 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0031400 con 0x7fd3f8155df0 2024-08-17T02:30:09.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.279+0000 7fd3f7e00640 1 -- 172.21.15.110:0/2425787966 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f002d050 con 0x7fd3f8155df0 2024-08-17T02:30:09.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.279+0000 7fd3f7e00640 1 -- 172.21.15.110:0/2425787966 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0031790 con 0x7fd3f8155df0 2024-08-17T02:30:09.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 -- 172.21.15.110:0/2425787966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 msgr2=0x7fd3f80ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 --2- 172.21.15.110:0/2425787966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f20 tx=0x7fd3f0009840 comp rx=0 tx=0).stop 2024-08-17T02:30:09.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 -- 172.21.15.110:0/2425787966 shutdown_connections 2024-08-17T02:30:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 --2- 172.21.15.110:0/2425787966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80ad9b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 --2- 172.21.15.110:0/2425787966 >> v2:172.21.15.177:3300/0 conn(0x7fd3f806df00 0x7fd3f80adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 -- 172.21.15.110:0/2425787966 >> 172.21.15.110:0/2425787966 conn(0x7fd3f80cb9b0 msgr2=0x7fd3f80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 -- 172.21.15.110:0/2425787966 shutdown_connections 2024-08-17T02:30:09.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.280+0000 7fd400000640 1 -- 172.21.15.110:0/2425787966 wait complete. 2024-08-17T02:30:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.281+0000 7fd400000640 1 Processor -- start 2024-08-17T02:30:09.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 -- start start 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3f806df00 0x7fd3f814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80a79f0 con 0x7fd3f8155a20 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80a6de0 con 0x7fd3f806df00 2024-08-17T02:30:09.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.282+0000 7fd400000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f80a70c0 con 0x7fd3f8155df0 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35012/0 (socket says 172.21.15.110:35012) 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 -- 172.21.15.110:0/675610739 learned_addr learned my addr 172.21.15.110:0/675610739 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fe000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fd600640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3f806df00 0x7fd3f814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 -- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 msgr2=0x7fd3f80a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 -- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3f806df00 msgr2=0x7fd3f814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3f806df00 0x7fd3f814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 -- 172.21.15.110:0/675610739 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009ae0 con 0x7fd3f8155a20 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fe000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.283+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009fd0 tx=0x7fd3e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.284+0000 7fd3f4c00640 1 -- 172.21.15.110:0/675610739 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400c940 con 0x7fd3f8155a20 2024-08-17T02:30:09.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.284+0000 7fd3f4c00640 1 -- 172.21.15.110:0/675610739 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e400caa0 con 0x7fd3f8155a20 2024-08-17T02:30:09.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.284+0000 7fd3f4c00640 1 -- 172.21.15.110:0/675610739 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400ce40 con 0x7fd3f8155a20 2024-08-17T02:30:09.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.284+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f80a73a0 con 0x7fd3f8155a20 2024-08-17T02:30:09.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.284+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f80a6000 con 0x7fd3f8155a20 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.286+0000 7fd3f4c00640 1 -- 172.21.15.110:0/675610739 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd3e4013680 con 0x7fd3f8155a20 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.286+0000 7fd3f4c00640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 0x7fd3d8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.286+0000 7fd3f4c00640 1 -- 172.21.15.110:0/675610739 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3e4082790 con 0x7fd3f8155a20 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.287+0000 7fd3fd600640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 0x7fd3d8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.287+0000 7fd4025ac740 1 Processor -- start 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.287+0000 7fd3fd600640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 0x7fd3d8067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0011e0 tx=0x7fd3ec007b60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.288 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.287+0000 7fd4025ac740 1 -- start start 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad30e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 0x55f64ad05900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64acc6380 con 0x55f64ad0c0a0 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ac6f9e0 con 0x55f64ad4eb10 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64ac6d170 con 0x55f64ad30a30 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.288+0000 7fd3fcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35022/0 (socket says 172.21.15.110:35022) 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 -- 172.21.15.110:0/2429417162 learned_addr learned my addr 172.21.15.110:0/2429417162 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fd600640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad30e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fe000640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 0x55f64ad05900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 -- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 msgr2=0x55f64ad30e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad30e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 -- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 msgr2=0x55f64ad05900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 0x55f64ad05900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 -- 172.21.15.110:0/2429417162 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f64ac1c820 con 0x55f64ad0c0a0 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fe000640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 0x55f64ad05900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:09.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4054110 tx=0x7fd3e4080b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d8a48f0ed782fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3e9600640 1 -- 172.21.15.110:0/2429417162 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e401ef00 con 0x55f64ad0c0a0 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3e9600640 1 -- 172.21.15.110:0/2429417162 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4054470 con 0x55f64ad0c0a0 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.289+0000 7fd3e9600640 1 -- 172.21.15.110:0/2429417162 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e40576c0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 -- 172.21.15.110:0/2429417162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 msgr2=0x55f64ad4e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4054110 tx=0x7fd3e4080b70 comp rx=0 tx=0).stop 2024-08-17T02:30:09.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 -- 172.21.15.110:0/2429417162 shutdown_connections 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad4eb10 0x55f64ad05900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad4e5d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 --2- 172.21.15.110:0/2429417162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad30e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 -- 172.21.15.110:0/2429417162 >> 172.21.15.110:0/2429417162 conn(0x55f64aca4030 msgr2=0x55f64ad52c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 -- 172.21.15.110:0/2429417162 shutdown_connections 2024-08-17T02:30:09.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.290+0000 7fd4025ac740 1 -- 172.21.15.110:0/2429417162 wait complete. 2024-08-17T02:30:09.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.291+0000 7fd4025ac740 1 -- start start 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.291+0000 7fd4025ac740 1 Processor -- start 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad2ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad32990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ac68f60 con 0x55f64ad0c0a0 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ac11690 con 0x55f64ad30a30 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64ac11330 con 0x55f64ad4eb10 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd4025ac740 10 client.0 _ll_register_callbacks cb 0x55f64ac0b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd3fd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd3fd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35032/0 (socket says 172.21.15.110:35032) 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd3fd600640 1 -- 172.21.15.110:0/4043926487 learned_addr learned my addr 172.21.15.110:0/4043926487 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd3fe000640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad32990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.292+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad2ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 -- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 msgr2=0x55f64ad32990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad32990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 -- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 msgr2=0x55f64ad2ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad2ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 -- 172.21.15.110:0/4043926487 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f80a6000 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad2ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3fd600640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec014430 tx=0x7fd3ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc79fee7e8b73595 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3de000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec012590 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f64ac9cd20 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3ec0126f0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3ec012ac0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd4025ac740 10 client.5133 fetch_fsmap learned FSMap version 17 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.293+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f64ac32ab0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f64ac9cd20 con 0x55f64ad0c0a0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd3ec020070 con 0x55f64ad0c0a0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 10 client.5133 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 20 client.5133 populate_metadata read hostname 'smithi110' 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64ad32ed0 0x55f64ad332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 4 client.5133 mds_command: new command op to 4920 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 --> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f64a9703c0 con 0x55f64ad32ed0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.294+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64ad32ed0 0x55f64ad332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64ad32ed0 0x55f64ad332a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746e6344a4b67ef9 server_cookie=588dba421f4b0bc in_seq=0 out_seq=0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd3de000640 10 client.5133 ms_handle_connect on v2:172.21.15.110:6834/3374805694 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd3de000640 1 -- 172.21.15.110:0/4043926487 <== mds.0 v2:172.21.15.110:6834/3374805694 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55f64a9703c0 con 0x55f64ad32ed0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd3de000640 10 client.5133 handle_command_reply: tid=0 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 client.5133 shutdown 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 msgr2=0x55f64ad2ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec014430 tx=0x7fd3ec013000 comp rx=0 tx=0).stop 2024-08-17T02:30:09.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 shutdown_connections 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64ad32ed0 0x55f64ad332a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad32990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad2ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd3de000640 0 client.5133 ms_handle_reset on v2:172.21.15.110:6834/3374805694 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.295+0000 7fd4025ac740 1 --2- 172.21.15.110:0/4043926487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad2ea00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.296+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 >> 172.21.15.110:0/4043926487 conn(0x55f64aca4030 msgr2=0x55f64ad52750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.296+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 shutdown_connections 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.296+0000 7fd4025ac740 1 -- 172.21.15.110:0/4043926487 wait complete. 2024-08-17T02:30:09.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.296+0000 7fd4025ac740 20 client.5133 trim_cache size 0 max 16384 2024-08-17T02:30:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.311+0000 7fd4025ac740 1 Processor -- start 2024-08-17T02:30:09.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.311+0000 7fd4025ac740 1 -- start start 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad690e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64a9e3f20 con 0x55f64ad0c0a0 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ad2f8e0 con 0x55f64ad30a30 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.312+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64ad08930 con 0x55f64ad4eb10 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35040/0 (socket says 172.21.15.110:35040) 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 -- 172.21.15.110:0/3980203308 learned_addr learned my addr 172.21.15.110:0/3980203308 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.313 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fe000640 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 -- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 msgr2=0x55f64ad529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 -- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 msgr2=0x55f64ad690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 -- 172.21.15.110:0/3980203308 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f64ac36490 con 0x55f64ad0c0a0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.313+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec005fd0 tx=0x7fd3ec017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1530e801a6dc2c52 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd3ea000640 1 -- 172.21.15.110:0/3980203308 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec014cc0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd3ea000640 1 -- 172.21.15.110:0/3980203308 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec000c30 con 0x55f64ad0c0a0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd3ea000640 1 -- 172.21.15.110:0/3980203308 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec012ac0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 -- 172.21.15.110:0/3980203308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 msgr2=0x55f64ad68ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec005fd0 tx=0x7fd3ec017070 comp rx=0 tx=0).stop 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 -- 172.21.15.110:0/3980203308 shutdown_connections 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad4eb10 0x55f64ad529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad30a30 0x55f64ad690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3980203308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad0c0a0 0x55f64ad68ba0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 -- 172.21.15.110:0/3980203308 >> 172.21.15.110:0/3980203308 conn(0x55f64aca4030 msgr2=0x55f64ad06510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 -- 172.21.15.110:0/3980203308 shutdown_connections 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.314+0000 7fd4025ac740 1 -- 172.21.15.110:0/3980203308 wait complete. 2024-08-17T02:30:09.316 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.315+0000 7fd4025ac740 1 -- start start 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.315+0000 7fd4025ac740 1 Processor -- start 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad0c0a0 0x55f64ad03e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad04360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ad4dd50 con 0x55f64ad4eb10 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f64ad04ce0 con 0x55f64ad0c0a0 2024-08-17T02:30:09.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f64ad37110 con 0x55f64ad30a30 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd4025ac740 10 client.0 _ll_register_callbacks cb 0x7fd3ec0072f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd3fe000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd3fe000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35048/0 (socket says 172.21.15.110:35048) 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd3fe000640 1 -- 172.21.15.110:0/3503444620 learned_addr learned my addr 172.21.15.110:0/3503444620 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad0c0a0 0x55f64ad03e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.316+0000 7fd3fcc00640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad04360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 -- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 msgr2=0x55f64ad04360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad04360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 -- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad0c0a0 msgr2=0x55f64ad03e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad0c0a0 0x55f64ad03e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 -- 172.21.15.110:0/3503444620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f64ac32ab0 con 0x55f64ad4eb10 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3fe000640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f80 tx=0x7fd3f0036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32322cc42fa8026 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3de000640 10 client.0 ms_handle_connect on v2:172.21.15.110:3300/0 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0042050 con 0x55f64ad4eb10 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mon.0 v2:172.21.15.110:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3f003d760 con 0x55f64ad4eb10 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3e4054470 con 0x55f64ad4eb10 2024-08-17T02:30:09.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3f003db30 con 0x55f64ad4eb10 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd4025ac740 10 client.5139 fetch_fsmap learned FSMap version 17 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.317+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f64ac361e0 con 0x55f64ad4eb10 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mon.0 v2:172.21.15.110:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4054470 con 0x55f64ad4eb10 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mon.0 v2:172.21.15.110:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd3f003dc90 con 0x55f64ad4eb10 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 10 client.5139 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 10 client.5139 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 20 client.5139 populate_metadata read hostname 'smithi110' 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64adb6fd0 0x55f64ad684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 4 client.5139 mds_command: new command op to 4920 tid=0[{"prefix": "status"}] 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 --> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f64a9816c0 con 0x55f64adb6fd0 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64adb6fd0 0x55f64ad684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd3de000640 10 client.5139 ms_handle_connect on v2:172.21.15.110:6834/3374805694 2024-08-17T02:30:09.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.318+0000 7fd3fd600640 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64adb6fd0 0x55f64ad684a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42db0b01e9f43e1b server_cookie=9b5aca4a5dc503ef in_seq=0 out_seq=0 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd3de000640 1 -- 172.21.15.110:0/3503444620 <== mds.0 v2:172.21.15.110:6834/3374805694 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55f64a9816c0 con 0x55f64adb6fd0 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd3de000640 10 client.5139 handle_command_reply: tid=0 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 client.5139 shutdown 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 msgr2=0x55f64adb6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009f80 tx=0x7fd3f0036000 comp rx=0 tx=0).stop 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 shutdown_connections 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:6834/3374805694,v1:172.21.15.110:6835/3374805694] conn(0x55f64adb6fd0 0x55f64ad684a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f64ad4eb10 0x55f64adb6a90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f64ad30a30 0x55f64ad04360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd3de000640 0 client.5139 ms_handle_reset on v2:172.21.15.110:6834/3374805694 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 --2- 172.21.15.110:0/3503444620 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f64ad0c0a0 0x55f64ad03e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 >> 172.21.15.110:0/3503444620 conn(0x55f64aca4030 msgr2=0x55f64ad52e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 shutdown_connections 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 1 -- 172.21.15.110:0/3503444620 wait complete. 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.319+0000 7fd4025ac740 20 client.5139 trim_cache size 0 max 16384 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "cluster_fsid": "19a3b248-ccfd-4c4b-910e-9f89c1cc3c77", 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "whoami": 0, 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "id": 4920, 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "want_state": "up:active", 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "state": "up:active", 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "fs_name": "cephfs", 2024-08-17T02:30:09.327 INFO:teuthology.orchestra.run.smithi110.stdout: "rank_uptime": 10.609603598, 2024-08-17T02:30:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "mdsmap_epoch": 17, 2024-08-17T02:30:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch": 33, 2024-08-17T02:30:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "osdmap_epoch_barrier": 33, 2024-08-17T02:30:09.328 INFO:teuthology.orchestra.run.smithi110.stdout: "uptime": 18.442673479 2024-08-17T02:30:09.328 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:30:09.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 msgr2=0x7fd3d8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 0x7fd3d8067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0011e0 tx=0x7fd3ec007b60 comp rx=0 tx=0).stop 2024-08-17T02:30:09.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 msgr2=0x7fd3f80a62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009fd0 tx=0x7fd3e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 shutdown_connections 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd3d8065150 0x7fd3d8067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3f8155df0 0x7fd3f80a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3f8155a20 0x7fd3f80a62b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 --2- 172.21.15.110:0/675610739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3f806df00 0x7fd3f814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 >> 172.21.15.110:0/675610739 conn(0x7fd3f80cb9b0 msgr2=0x7fd3f806c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 shutdown_connections 2024-08-17T02:30:09.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.320+0000 7fd400000640 1 -- 172.21.15.110:0/675610739 wait complete. 2024-08-17T02:30:09.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:30:09.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.485+0000 7fa029600640 1 Processor -- start 2024-08-17T02:30:09.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.485+0000 7fa029600640 1 -- start start 2024-08-17T02:30:09.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa029600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa024155a20 0x7fa0240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa029600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa0240ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa029600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa024156670 con 0x7fa02406d7f0 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa029600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0240b0350 con 0x7fa024155a20 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa029600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02406e5e0 con 0x7fa024155df0 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.486+0000 7fa022a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa024155a20 0x7fa0240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa024155a20 0x7fa0240adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35050/0 (socket says 172.21.15.110:35050) 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 -- 172.21.15.110:0/3286815916 learned_addr learned my addr 172.21.15.110:0/3286815916 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa023400640 1 --1- 172.21.15.110:0/3286815916 >> v1:172.21.15.110:6789/0 conn(0x7fa02406d7f0 0x7fa0240ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37742/0 (socket says 172.21.15.110:37742) 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022000640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa0240ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 -- 172.21.15.110:0/3286815916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 msgr2=0x7fa0240ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa0240ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 -- 172.21.15.110:0/3286815916 >> v1:172.21.15.110:6789/0 conn(0x7fa02406d7f0 legacy=0x7fa0240ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa022a00640 1 -- 172.21.15.110:0/3286815916 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02406e8c0 con 0x7fa024155a20 2024-08-17T02:30:09.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.487+0000 7fa021600640 1 -- 172.21.15.110:0/3286815916 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848914222 0 0) 0x7fa024156670 con 0x7fa02406d7f0 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.488+0000 7fa022a00640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa0240adf10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa014009910 tx=0x7fa0140091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1a363bc9583613 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.488+0000 7fa021600640 1 -- 172.21.15.110:0/3286815916 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01402ae40 con 0x7fa024155a20 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.488+0000 7fa021600640 1 -- 172.21.15.110:0/3286815916 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa014032440 con 0x7fa024155a20 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.488+0000 7fa021600640 1 -- 172.21.15.110:0/3286815916 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140327e0 con 0x7fa024155a20 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 -- 172.21.15.110:0/3286815916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 msgr2=0x7fa0240adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa0240adf10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa014009910 tx=0x7fa0140091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 -- 172.21.15.110:0/3286815916 shutdown_connections 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa0240ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 --2- 172.21.15.110:0/3286815916 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa0240adf10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 -- 172.21.15.110:0/3286815916 >> 172.21.15.110:0/3286815916 conn(0x7fa0240cb9b0 msgr2=0x7fa0240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 -- 172.21.15.110:0/3286815916 shutdown_connections 2024-08-17T02:30:09.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.489+0000 7fa029600640 1 -- 172.21.15.110:0/3286815916 wait complete. 2024-08-17T02:30:09.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.490+0000 7fa029600640 1 Processor -- start 2024-08-17T02:30:09.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.490+0000 7fa029600640 1 -- start start 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 0x7fa024131c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa024069bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02414f300 con 0x7fa024155a20 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02414e6f0 con 0x7fa02406d7f0 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.491+0000 7fa029600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02414e9d0 con 0x7fa024155df0 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35056/0 (socket says 172.21.15.110:35056) 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 -- 172.21.15.110:0/295664268 learned_addr learned my addr 172.21.15.110:0/295664268 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022a00640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 0x7fa024131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa023400640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa024069bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 -- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 msgr2=0x7fa024069bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa024069bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 -- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 msgr2=0x7fa024131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 0x7fa024131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 -- 172.21.15.110:0/295664268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009450 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022a00640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 0x7fa024131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa022000640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa01000e900 tx=0x7fa0100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000c8e0 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01000ca40 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.492+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000cde0 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.493+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02414ecb0 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.493+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa024143ad0 con 0x7fa024155a20 2024-08-17T02:30:09.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.494+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02414f4b0 con 0x7fa024155a20 2024-08-17T02:30:09.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.494+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa010013680 con 0x7fa024155a20 2024-08-17T02:30:09.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.495+0000 7fa01a000640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 0x7fa004067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:09.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.495+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa0100826a0 con 0x7fa024155a20 2024-08-17T02:30:09.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.495+0000 7fa022a00640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 0x7fa004067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:09.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.496+0000 7fa022a00640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 0x7fa004067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa014034000 tx=0x7fa014032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:09.499 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.499+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa02414f4b0 con 0x7fa024155a20 2024-08-17T02:30:09.710 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.710+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa02414f4b0 con 0x7fa024155a20 2024-08-17T02:30:09.711 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.710+0000 7fa01a000640 1 -- 172.21.15.110:0/295664268 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa02414f4b0 con 0x7fa024155a20 2024-08-17T02:30:09.711 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 msgr2=0x7fa004067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 0x7fa004067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa014034000 tx=0x7fa014032000 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 msgr2=0x7fa024143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa01000e900 tx=0x7fa0100090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 shutdown_connections 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa004065150 0x7fa004067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa024155df0 0x7fa024069bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa024155a20 0x7fa024143590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 --2- 172.21.15.110:0/295664268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa02406d7f0 0x7fa024131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 >> 172.21.15.110:0/295664268 conn(0x7fa0240cb9b0 msgr2=0x7fa0241580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:09.713 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 shutdown_connections 2024-08-17T02:30:09.714 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:09.712+0000 7fa029600640 1 -- 172.21.15.110:0/295664268 wait complete. 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:09.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:30:09.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:30:09.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:30:09.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:30:09.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:09.728 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-08-17T02:30:09.763 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:09.764 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42621sec preferred_lft 42621sec 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 4e:61:a1:12:1f:ca brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ac8c:adff:fee0:3d2a/64 scope link 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 5a:8c:2c:d1:c6:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::588c:2cff:fed1:c60b/64 scope link 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.765 INFO:teuthology.orchestra.run.smithi110.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:30:09.766 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 4e:61:a1:12:1f:ca brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:30:09.766 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::4c61:a1ff:fe12:1fca/64 scope link 2024-08-17T02:30:09.766 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:09.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:09.767 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:30:09.861 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-08-17T02:30:09.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:09.864 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-08-17T02:30:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-08-17T02:30:09.900 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:30:09.901 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:30:09.901 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:30:09.901 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:30:09.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:30:09.901 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-08-17T02:30:10.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:10.046 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:30:10.081 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:30:10.081 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:30:10.081 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:30:10.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:10.082 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-08-17T02:30:10.177 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:30:10.177 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:10.212 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:30:10.212 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:30:10.213 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:10.286 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:30:10.286 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:30:10.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:10.408 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:10.408 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:30:10.434 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:10.434 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:30:10.435 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:30:10.435 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 0@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:30:10.435 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:30:10.436 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:30:10.436 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:30:10.436 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:30:10.436 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:30:10.436 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:30:10.439 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:30:10.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:10.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:30:10.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:30:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.642+0000 7fa7a9600640 1 Processor -- start 2024-08-17T02:30:10.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.642+0000 7fa7a9600640 1 -- start start 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a9600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa7a4155a20 0x7fa7a40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a9600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7a4155df0 0x7fa7a40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a9600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a4156670 con 0x7fa7a406d7f0 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a9600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40b0350 con 0x7fa7a4155df0 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a9600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a406e5e0 con 0x7fa7a4155a20 2024-08-17T02:30:10.644 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7a4155df0 0x7fa7a40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa7a4155df0 0x7fa7a40ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35072/0 (socket says 172.21.15.110:35072) 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.643+0000 7fa7a2000640 1 -- 172.21.15.110:0/107917449 learned_addr learned my addr 172.21.15.110:0/107917449 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.644+0000 7fa7a2a00640 1 --2- 172.21.15.110:0/107917449 >> v2:172.21.15.177:3300/0 conn(0x7fa7a4155a20 0x7fa7a40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.644+0000 7fa7a2000640 1 -- 172.21.15.110:0/107917449 >> v2:172.21.15.177:3300/0 conn(0x7fa7a4155a20 msgr2=0x7fa7a40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.644+0000 7fa7a2000640 1 --2- 172.21.15.110:0/107917449 >> v2:172.21.15.177:3300/0 conn(0x7fa7a4155a20 0x7fa7a40adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.644+0000 7fa7a2000640 1 -- 172.21.15.110:0/107917449 >> v1:172.21.15.110:6789/0 conn(0x7fa7a406d7f0 legacy=0x7fa7a40ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.644+0000 7fa7a2000640 1 -- 172.21.15.110:0/107917449 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a406e8c0 con 0x7fa7a4155df0 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.645+0000 7fa7a2000640 1 --2- 172.21.15.110:0/107917449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a4155df0 0x7fa7a40ad9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7a406bc00 tx=0x7fa7900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b114a8484218814a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:10.645 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.645+0000 7fa7a1600640 1 -- 172.21.15.110:0/107917449 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79002ae80 con 0x7fa7a4155df0 2024-08-17T02:30:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.645+0000 7fa7a1600640 1 -- 172.21.15.110:0/107917449 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa790032440 con 0x7fa7a4155df0 2024-08-17T02:30:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.645+0000 7fa7a1600640 1 -- 172.21.15.110:0/107917449 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa790032800 con 0x7fa7a4155df0 2024-08-17T02:30:10.646 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 -- 172.21.15.110:0/107917449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a4155df0 msgr2=0x7fa7a40ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 --2- 172.21.15.110:0/107917449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a4155df0 0x7fa7a40ad9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7a406bc00 tx=0x7fa7900091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 -- 172.21.15.110:0/107917449 shutdown_connections 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 --2- 172.21.15.110:0/107917449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a4155df0 0x7fa7a40ad9b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 --2- 172.21.15.110:0/107917449 >> v2:172.21.15.177:3300/0 conn(0x7fa7a4155a20 0x7fa7a40adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 -- 172.21.15.110:0/107917449 >> 172.21.15.110:0/107917449 conn(0x7fa7a40cb9b0 msgr2=0x7fa7a40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 -- 172.21.15.110:0/107917449 shutdown_connections 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.646+0000 7fa7a9600640 1 -- 172.21.15.110:0/107917449 wait complete. 2024-08-17T02:30:10.647 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.647+0000 7fa7a9600640 1 Processor -- start 2024-08-17T02:30:10.648 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.647+0000 7fa7a9600640 1 -- start start 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7a4155a20 0x7fa7a40ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a4155df0 0x7fa7a40a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40a7400 con 0x7fa7a406d7f0 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40a67f0 con 0x7fa7a4155df0 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40a6ad0 con 0x7fa7a4155a20 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35078/0 (socket says 172.21.15.110:35078) 2024-08-17T02:30:10.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.648+0000 7fa7a2a00640 1 -- 172.21.15.110:0/142820003 learned_addr learned my addr 172.21.15.110:0/142820003 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:10.650 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 -- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7a4155a20 msgr2=0x7fa7a40ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7a4155a20 0x7fa7a40ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 -- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a4155df0 msgr2=0x7fa7a40a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a4155df0 0x7fa7a40a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 -- 172.21.15.110:0/142820003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790009450 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a2a00640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa79400d890 tx=0x7fa794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400de20 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79400b8d0 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a40a6db0 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400bc70 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.649+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4141800 con 0x7fa7a406d7f0 2024-08-17T02:30:10.651 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.650+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a4064db0 con 0x7fa7a406d7f0 2024-08-17T02:30:10.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.651+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa794014640 con 0x7fa7a406d7f0 2024-08-17T02:30:10.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.652+0000 7fa79a000640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 0x7fa784067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:10.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.652+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa794082b40 con 0x7fa7a406d7f0 2024-08-17T02:30:10.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.652+0000 7fa7a2000640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 0x7fa784067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:10.653 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.653+0000 7fa7a2000640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 0x7fa784067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa790034000 tx=0x7fa790032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:10.656 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.656+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa794050b60 con 0x7fa7a406d7f0 2024-08-17T02:30:10.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.867+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7a4069240 con 0x7fa7a406d7f0 2024-08-17T02:30:10.868 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.867+0000 7fa79a000640 1 -- 172.21.15.110:0/142820003 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa794054180 con 0x7fa7a406d7f0 2024-08-17T02:30:10.868 INFO:teuthology.orchestra.run.smithi110.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:30:10.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 msgr2=0x7fa784067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 0x7fa784067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa790034000 tx=0x7fa790032000 comp rx=0 tx=0).stop 2024-08-17T02:30:10.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 msgr2=0x7fa7a41412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:10.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa79400d890 tx=0x7fa794008040 comp rx=0 tx=0).stop 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 shutdown_connections 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa784065150 0x7fa784067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7a4155df0 0x7fa7a40a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7a4155a20 0x7fa7a40ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 --2- 172.21.15.110:0/142820003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7a406d7f0 0x7fa7a41412c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.869+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 >> 172.21.15.110:0/142820003 conn(0x7fa7a40cb9b0 msgr2=0x7fa7a41504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.870+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 shutdown_connections 2024-08-17T02:30:10.871 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:10.870+0000 7fa7a9600640 1 -- 172.21.15.110:0/142820003 wait complete. 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:30:10.885 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:30:10.886 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:30:10.886 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:30:10.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:10.886 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:10.926 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42613sec preferred_lft 42613sec 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-08-17T02:30:10.927 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 2e:fb:ad:b8:39:4b brd ff:ff:ff:ff:ff:ff 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::241c:4cff:fe2b:94aa/64 scope link 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 7e:25:22:21:42:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::7c25:22ff:fe21:4262/64 scope link 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 2e:fb:ad:b8:39:4b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::2cfb:adff:feb8:394b/64 scope link 2024-08-17T02:30:10.928 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:30:10.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:10.929 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:30:11.023 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-08-17T02:30:11.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:11.027 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-08-17T02:30:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-08-17T02:30:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:30:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:30:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:30:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:30:11.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:30:11.065 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-08-17T02:30:11.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:11.211 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:30:11.247 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:30:11.247 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:30:11.247 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:30:11.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:11.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-08-17T02:30:11.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:30:11.346 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:11.381 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:30:11.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:30:11.382 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:11.457 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:30:11.457 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:30:11.457 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:11.581 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:11.581 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:30:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:30:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:30:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.110:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-08-17T02:30:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with new device syntax: 1@19a3b248-ccfd-4c4b-910e-9f89c1cc3c77.cephfs=/ 2024-08-17T02:30:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.110:3300/172.21.15.177:3300/172.21.15.177:3301" will pass to kernel 2024-08-17T02:30:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:30:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:30:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:30:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:30:11.610 INFO:teuthology.orchestra.run.smithi177.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:30:11.613 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:30:11.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:30:11.613 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:30:11.670 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:30:11.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.825+0000 7fc8d2200640 1 Processor -- start 2024-08-17T02:30:11.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.825+0000 7fc8d2200640 1 -- start start 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8d2200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8cc158cf0 0x7fc8cc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8d2200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc8cc069240 0x7fc8cc0af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8d2200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8cc0aef10 con 0x7fc8cc1590c0 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8d2200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc0b0910 con 0x7fc8cc158cf0 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8d2200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8cc0696f0 con 0x7fc8cc069240 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8cb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8cc158cf0 0x7fc8cc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8cb400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8cc158cf0 0x7fc8cc068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35088/0 (socket says 172.21.15.110:35088) 2024-08-17T02:30:11.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.826+0000 7fc8cb400640 1 -- 172.21.15.110:0/1839555544 learned_addr learned my addr 172.21.15.110:0/1839555544 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.827+0000 7fc8cbe00640 1 --2- 172.21.15.110:0/1839555544 >> v2:172.21.15.177:3300/0 conn(0x7fc8cc069240 0x7fc8cc0af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.827+0000 7fc8cb400640 1 -- 172.21.15.110:0/1839555544 >> v2:172.21.15.177:3300/0 conn(0x7fc8cc069240 msgr2=0x7fc8cc0af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.827+0000 7fc8cb400640 1 --2- 172.21.15.110:0/1839555544 >> v2:172.21.15.177:3300/0 conn(0x7fc8cc069240 0x7fc8cc0af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.827+0000 7fc8cb400640 1 -- 172.21.15.110:0/1839555544 >> v1:172.21.15.177:6789/0 conn(0x7fc8cc1590c0 legacy=0x7fc8cc0ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.827+0000 7fc8cb400640 1 -- 172.21.15.110:0/1839555544 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc0ae5e0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.828+0000 7fc8cb400640 1 --2- 172.21.15.110:0/1839555544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc068d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06dff0 tx=0x7fc8bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794c22b705c77290 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:11.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.828+0000 7fc8ca000640 1 -- 172.21.15.110:0/1839555544 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc02ae80 con 0x7fc8cc158cf0 2024-08-17T02:30:11.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.828+0000 7fc8ca000640 1 -- 172.21.15.110:0/1839555544 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc032440 con 0x7fc8cc158cf0 2024-08-17T02:30:11.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.828+0000 7fc8ca000640 1 -- 172.21.15.110:0/1839555544 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc032800 con 0x7fc8cc158cf0 2024-08-17T02:30:11.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 -- 172.21.15.110:0/1839555544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 msgr2=0x7fc8cc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 --2- 172.21.15.110:0/1839555544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc068d00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc06dff0 tx=0x7fc8bc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 -- 172.21.15.110:0/1839555544 shutdown_connections 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 --2- 172.21.15.110:0/1839555544 >> v2:172.21.15.177:3300/0 conn(0x7fc8cc069240 0x7fc8cc0af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 --2- 172.21.15.110:0/1839555544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc068d00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 -- 172.21.15.110:0/1839555544 >> 172.21.15.110:0/1839555544 conn(0x7fc8cc096a70 msgr2=0x7fc8cc096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 -- 172.21.15.110:0/1839555544 shutdown_connections 2024-08-17T02:30:11.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.829+0000 7fc8d2200640 1 -- 172.21.15.110:0/1839555544 wait complete. 2024-08-17T02:30:11.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.830+0000 7fc8d2200640 1 Processor -- start 2024-08-17T02:30:11.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.830+0000 7fc8d2200640 1 -- start start 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8cc069240 0x7fc8cc098400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc1590c0 0x7fc8cc1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc099ec0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc098940 con 0x7fc8cc1590c0 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8d2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc098fd0 con 0x7fc8cc069240 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8caa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35100/0 (socket says 172.21.15.110:35100) 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.831+0000 7fc8caa00640 1 -- 172.21.15.110:0/4217070340 learned_addr learned my addr 172.21.15.110:0/4217070340 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8cb400640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8cc069240 0x7fc8cc098400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8cbe00640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc1590c0 0x7fc8cc1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 -- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8cc069240 msgr2=0x7fc8cc098400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8cc069240 0x7fc8cc098400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 -- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc1590c0 msgr2=0x7fc8cc1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc1590c0 0x7fc8cc1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 -- 172.21.15.110:0/4217070340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009450 con 0x7fc8cc158cf0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8caa00640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c4c0 tx=0x7fc8b8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011590 con 0x7fc8cc158cf0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8011710 con 0x7fc8cc158cf0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8011ad0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.832+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc0992b0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.833+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc0998f0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.834+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc09a070 con 0x7fc8cc158cf0 2024-08-17T02:30:11.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.834+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc8b801b3b0 con 0x7fc8cc158cf0 2024-08-17T02:30:11.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.835+0000 7fc8c2a00640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 0x7fc8ac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:11.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.835+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8b8081880 con 0x7fc8cc158cf0 2024-08-17T02:30:11.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.835+0000 7fc8cb400640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 0x7fc8ac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:11.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.836+0000 7fc8cb400640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 0x7fc8ac067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc034000 tx=0x7fc8bc032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:11.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:11.839+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc8cc09a070 con 0x7fc8cc158cf0 2024-08-17T02:30:12.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.049+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8cc0710c0 con 0x7fc8cc158cf0 2024-08-17T02:30:12.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.777+0000 7fc8c2a00640 1 -- 172.21.15.110:0/4217070340 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7fc8b804f950 con 0x7fc8cc158cf0 2024-08-17T02:30:12.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 msgr2=0x7fc8ac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 0x7fc8ac067630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc034000 tx=0x7fc8bc032000 comp rx=0 tx=0).stop 2024-08-17T02:30:12.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 msgr2=0x7fc8cc152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c4c0 tx=0x7fc8b8007ef0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 shutdown_connections 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc8ac065180 0x7fc8ac067630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc1590c0 0x7fc8cc1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8cc158cf0 0x7fc8cc152370 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 --2- 172.21.15.110:0/4217070340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8cc069240 0x7fc8cc098400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 >> 172.21.15.110:0/4217070340 conn(0x7fc8cc096a70 msgr2=0x7fc8cc1557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 shutdown_connections 2024-08-17T02:30:12.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.780+0000 7fc8d2200640 1 -- 172.21.15.110:0/4217070340 wait complete. 2024-08-17T02:30:12.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:30:12.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.948+0000 7f32a0000640 1 Processor -- start 2024-08-17T02:30:12.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.948+0000 7f32a0000640 1 -- start start 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f32a0000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f32980caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f32a0000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32980caa80 con 0x7f32981401b0 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f32a0000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32980c9e70 con 0x7f3298140580 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f32a0000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980cb450 con 0x7f32980b1440 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f329d600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f32981401b0 0x7f32980b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37756/0 (socket says 172.21.15.110:37756) 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.949+0000 7f329d600640 1 -- 172.21.15.110:0/2285444757 learned_addr learned my addr 172.21.15.110:0/2285444757 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:12.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f329cc00640 1 --2- 172.21.15.110:0/2285444757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f32980caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162192207 0 0) 0x7f32980caa80 con 0x7f32981401b0 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32800034e0 con 0x7f32981401b0 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420005115 0 0) 0x7f32980c9e70 con 0x7f3298140580 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32980caa80 con 0x7f3298140580 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f329cc00640 1 -- 172.21.15.110:0/2285444757 >> v1:172.21.15.177:6789/0 conn(0x7f3298140580 legacy=0x7f32980c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f329cc00640 1 -- 172.21.15.110:0/2285444757 >> v1:172.21.15.110:6789/0 conn(0x7f32981401b0 legacy=0x7f32980b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.950+0000 7f329cc00640 1 -- 172.21.15.110:0/2285444757 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32980ca150 con 0x7f32980b1440 2024-08-17T02:30:12.952 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.951+0000 7f329cc00640 1 --2- 172.21.15.110:0/2285444757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f32980caf10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3284009880 tx=0x7f32840090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705fd5d2862041dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.951+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328402ae10 con 0x7f32980b1440 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.951+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284032440 con 0x7f32980b1440 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.951+0000 7f3297e00640 1 -- 172.21.15.110:0/2285444757 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840327e0 con 0x7f32980b1440 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 -- 172.21.15.110:0/2285444757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 msgr2=0x7f32980caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 --2- 172.21.15.110:0/2285444757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f32980caf10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3284009880 tx=0x7f32840090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 -- 172.21.15.110:0/2285444757 shutdown_connections 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 --2- 172.21.15.110:0/2285444757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f32980caf10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 -- 172.21.15.110:0/2285444757 >> 172.21.15.110:0/2285444757 conn(0x7f32980cb9b0 msgr2=0x7f32980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 -- 172.21.15.110:0/2285444757 shutdown_connections 2024-08-17T02:30:12.953 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.952+0000 7f32a0000640 1 -- 172.21.15.110:0/2285444757 wait complete. 2024-08-17T02:30:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.953+0000 7f32a0000640 1 Processor -- start 2024-08-17T02:30:12.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.954+0000 7f32a0000640 1 -- start start 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.954+0000 7f32a0000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f3298167830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f32a0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32981401b0 0x7f32980c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f32a0000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f32a0000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980c7b80 con 0x7f3298140580 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f32a0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980c6f70 con 0x7f32981401b0 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f32a0000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980c7250 con 0x7f32980b1440 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35104/0 (socket says 172.21.15.110:35104) 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 -- 172.21.15.110:0/844948729 learned_addr learned my addr 172.21.15.110:0/844948729 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329cc00640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32981401b0 0x7f32980c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:12.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329d600640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f3298167830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 -- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 msgr2=0x7f3298167830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f3298167830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 -- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32981401b0 msgr2=0x7f32980c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32981401b0 0x7f32980c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.955+0000 7f329e000640 1 -- 172.21.15.110:0/844948729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009390 con 0x7f3298140580 2024-08-17T02:30:12.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f329e000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f329000c910 tx=0x7f32900026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000cea0 con 0x7f3298140580 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329000a850 con 0x7f3298140580 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32980c7530 con 0x7f3298140580 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329000ac70 con 0x7f3298140580 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.956+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32980c6c60 con 0x7f3298140580 2024-08-17T02:30:12.958 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.957+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32980c7cf0 con 0x7f3298140580 2024-08-17T02:30:12.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.958+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3290012630 con 0x7f3298140580 2024-08-17T02:30:12.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.959+0000 7f3294c00640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 0x7f3278067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:12.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.959+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f32900826e0 con 0x7f3298140580 2024-08-17T02:30:12.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.959+0000 7f329d600640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 0x7f3278067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:12.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.959+0000 7f329d600640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 0x7f3278067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32980b18a0 tx=0x7f328c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:12.963 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:12.962+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32900507b0 con 0x7f3298140580 2024-08-17T02:30:13.156 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.156+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3298064db0 con 0x7f3278065150 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.157+0000 7f3294c00640 1 -- 172.21.15.110:0/844948729 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3298064db0 con 0x7f3278065150 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephfs" 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:30:13.158 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.159+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 msgr2=0x7f3278067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.159+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 0x7f3278067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f32980b18a0 tx=0x7f328c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.159+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 msgr2=0x7f329813d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.159+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f329000c910 tx=0x7f32900026f0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 shutdown_connections 2024-08-17T02:30:13.160 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3278065150 0x7f3278067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3298140580 0x7f329813d160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32981401b0 0x7f32980c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 --2- 172.21.15.110:0/844948729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32980b1440 0x7f3298167830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 >> 172.21.15.110:0/844948729 conn(0x7f32980cb9b0 msgr2=0x7f329813f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 shutdown_connections 2024-08-17T02:30:13.161 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.160+0000 7f32a0000640 1 -- 172.21.15.110:0/844948729 wait complete. 2024-08-17T02:30:13.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:30:13.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.325+0000 7fbc75400640 1 Processor -- start 2024-08-17T02:30:13.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.325+0000 7fbc75400640 1 -- start start 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc75400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbc70069230 0x7fbc70069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc75400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc70096e70 0x7fbc700abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc75400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc700ac4f0 con 0x7fbc70067de0 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc75400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700ad010 con 0x7fbc70096e70 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc75400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700ae3a0 con 0x7fbc70069230 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc6f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc70096e70 0x7fbc700abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc6f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc70096e70 0x7fbc700abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35112/0 (socket says 172.21.15.110:35112) 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc6f400640 1 -- 172.21.15.110:0/338489590 learned_addr learned my addr 172.21.15.110:0/338489590 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc74a00640 1 --1- 172.21.15.110:0/338489590 >> v1:172.21.15.110:6789/0 conn(0x7fbc70067de0 0x7fbc700681e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37766/0 (socket says 172.21.15.110:37766) 2024-08-17T02:30:13.327 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.326+0000 7fbc6fe00640 1 --2- 172.21.15.110:0/338489590 >> v2:172.21.15.177:3300/0 conn(0x7fbc70069230 0x7fbc70069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.327+0000 7fbc6f400640 1 -- 172.21.15.110:0/338489590 >> v2:172.21.15.177:3300/0 conn(0x7fbc70069230 msgr2=0x7fbc70069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.327+0000 7fbc6f400640 1 --2- 172.21.15.110:0/338489590 >> v2:172.21.15.177:3300/0 conn(0x7fbc70069230 0x7fbc70069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.327+0000 7fbc6f400640 1 -- 172.21.15.110:0/338489590 >> v1:172.21.15.110:6789/0 conn(0x7fbc70067de0 legacy=0x7fbc700681e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.327+0000 7fbc6f400640 1 -- 172.21.15.110:0/338489590 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc700ac770 con 0x7fbc70096e70 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.328+0000 7fbc6f400640 1 --2- 172.21.15.110:0/338489590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70096e70 0x7fbc700abfb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc700677c0 tx=0x7fbc5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55e3e7827394482 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.328+0000 7fbc6ea00640 1 -- 172.21.15.110:0/338489590 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c02add0 con 0x7fbc70096e70 2024-08-17T02:30:13.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.328+0000 7fbc6ea00640 1 -- 172.21.15.110:0/338489590 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c032440 con 0x7fbc70096e70 2024-08-17T02:30:13.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.328+0000 7fbc6ea00640 1 -- 172.21.15.110:0/338489590 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c032820 con 0x7fbc70096e70 2024-08-17T02:30:13.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 -- 172.21.15.110:0/338489590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70096e70 msgr2=0x7fbc700abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 --2- 172.21.15.110:0/338489590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70096e70 0x7fbc700abfb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc700677c0 tx=0x7fbc5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 -- 172.21.15.110:0/338489590 shutdown_connections 2024-08-17T02:30:13.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 --2- 172.21.15.110:0/338489590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70096e70 0x7fbc700abfb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 --2- 172.21.15.110:0/338489590 >> v2:172.21.15.177:3300/0 conn(0x7fbc70069230 0x7fbc70069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 -- 172.21.15.110:0/338489590 >> 172.21.15.110:0/338489590 conn(0x7fbc70096a70 msgr2=0x7fbc700cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 -- 172.21.15.110:0/338489590 shutdown_connections 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.329+0000 7fbc75400640 1 -- 172.21.15.110:0/338489590 wait complete. 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.330+0000 7fbc75400640 1 Processor -- start 2024-08-17T02:30:13.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.330+0000 7fbc75400640 1 -- start start 2024-08-17T02:30:13.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc70067de0 0x7fbc70098990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc70096e70 0x7fbc7009a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70098ed0 con 0x7fbc70069230 2024-08-17T02:30:13.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70155cc0 con 0x7fbc70067de0 2024-08-17T02:30:13.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc75400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc70154440 con 0x7fbc70096e70 2024-08-17T02:30:13.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc6f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc6f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35114/0 (socket says 172.21.15.110:35114) 2024-08-17T02:30:13.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.331+0000 7fbc6f400640 1 -- 172.21.15.110:0/1632215422 learned_addr learned my addr 172.21.15.110:0/1632215422 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:13.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6fe00640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc70067de0 0x7fbc70098990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc74a00640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc70096e70 0x7fbc7009a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 -- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc70096e70 msgr2=0x7fbc7009a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc70096e70 0x7fbc7009a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 -- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc70067de0 msgr2=0x7fbc70098990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc70067de0 0x7fbc70098990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 -- 172.21.15.110:0/1632215422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5c009450 con 0x7fbc70069230 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc6f400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009210 tx=0x7fbc5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c031c80 con 0x7fbc70069230 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c031e00 con 0x7fbc70069230 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.332+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc701546e0 con 0x7fbc70069230 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.333+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c03d670 con 0x7fbc70069230 2024-08-17T02:30:13.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.333+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc70154ca0 con 0x7fbc70069230 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.334+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc70155a70 con 0x7fbc70069230 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.334+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc5c039040 con 0x7fbc70069230 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.335+0000 7fbc67400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 0x7fbc50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.335+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc5c0a25c0 con 0x7fbc70069230 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.335+0000 7fbc6fe00640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 0x7fbc50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.336+0000 7fbc6fe00640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 0x7fbc50067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc70097800 tx=0x7fbc600090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.339+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc5c070690 con 0x7fbc70069230 2024-08-17T02:30:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.518+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbc70071050 con 0x7fbc70069230 2024-08-17T02:30:13.519 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.519+0000 7fbc67400640 1 -- 172.21.15.110:0/1632215422 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc5c0a0e60 con 0x7fbc70069230 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.520+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 msgr2=0x7fbc50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.520+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 0x7fbc50067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc70097800 tx=0x7fbc600090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.520+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 msgr2=0x7fbc70153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.520+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009210 tx=0x7fbc5c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.520+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 shutdown_connections 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbc50065150 0x7fbc50067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc70096e70 0x7fbc7009a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.521 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc70069230 0x7fbc70153f00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 --2- 172.21.15.110:0/1632215422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc70067de0 0x7fbc70098990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 >> 172.21.15.110:0/1632215422 conn(0x7fbc70096a70 msgr2=0x7fbc700ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:13.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 shutdown_connections 2024-08-17T02:30:13.522 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.521+0000 7fbc75400640 1 -- 172.21.15.110:0/1632215422 wait complete. 2024-08-17T02:30:13.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000013181 2024-08-17T02:30:13.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.688+0000 7f5f22e00640 1 Processor -- start 2024-08-17T02:30:13.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.688+0000 7f5f22e00640 1 -- start start 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f22e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f22e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 0x7f5f1c0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f22e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1c15b030 con 0x7f5f1c156990 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f22e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0cc2e0 con 0x7f5f1c156d60 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f22e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1c0ae0f0 con 0x7f5f1c0adcf0 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f1b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f1be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5f1c156990 0x7f5f1c0b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37780/0 (socket says 172.21.15.110:37780) 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f1be00640 1 -- 172.21.15.110:0/3094668836 learned_addr learned my addr 172.21.15.110:0/3094668836 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.689+0000 7f5f1b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35130/0 (socket says 172.21.15.110:35130) 2024-08-17T02:30:13.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f20e00640 1 --2- 172.21.15.110:0/3094668836 >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 0x7f5f1c0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f1b400640 1 -- 172.21.15.110:0/3094668836 >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 msgr2=0x7f5f1c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f1b400640 1 --2- 172.21.15.110:0/3094668836 >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 0x7f5f1c0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f1b400640 1 -- 172.21.15.110:0/3094668836 >> v1:172.21.15.110:6789/0 conn(0x7f5f1c156990 legacy=0x7f5f1c0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f1b400640 1 -- 172.21.15.110:0/3094668836 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0b1110 con 0x7f5f1c156d60 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.690+0000 7f5f20e00640 1 --2- 172.21.15.110:0/3094668836 >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 0x7f5f1c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:13.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.691+0000 7f5f1b400640 1 --2- 172.21.15.110:0/3094668836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c06c730 tx=0x7f5f080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43be673183d974e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.691+0000 7f5f1aa00640 1 -- 172.21.15.110:0/3094668836 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0802adb0 con 0x7f5f1c156d60 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.691+0000 7f5f1aa00640 1 -- 172.21.15.110:0/3094668836 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08032440 con 0x7f5f1c156d60 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.691+0000 7f5f1aa00640 1 -- 172.21.15.110:0/3094668836 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08032820 con 0x7f5f1c156d60 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 -- 172.21.15.110:0/3094668836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156d60 msgr2=0x7f5f1c0ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 --2- 172.21.15.110:0/3094668836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c06c730 tx=0x7f5f080090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 -- 172.21.15.110:0/3094668836 shutdown_connections 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 --2- 172.21.15.110:0/3094668836 >> v2:172.21.15.177:3300/0 conn(0x7f5f1c0adcf0 0x7f5f1c0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 --2- 172.21.15.110:0/3094668836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156d60 0x7f5f1c0ad7b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 -- 172.21.15.110:0/3094668836 >> 172.21.15.110:0/3094668836 conn(0x7f5f1c067750 msgr2=0x7f5f1c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 -- 172.21.15.110:0/3094668836 shutdown_connections 2024-08-17T02:30:13.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.692+0000 7f5f22e00640 1 -- 172.21.15.110:0/3094668836 wait complete. 2024-08-17T02:30:13.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.693+0000 7f5f22e00640 1 Processor -- start 2024-08-17T02:30:13.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.693+0000 7f5f22e00640 1 -- start start 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f1c0adcf0 0x7f5f1c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 0x7f5f1c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0c8f20 con 0x7f5f1c156990 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c0c9aa0 con 0x7f5f1c0adcf0 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f22e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c14e9f0 con 0x7f5f1c156d60 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.694+0000 7f5f1b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:35134/0 (socket says 172.21.15.110:35134) 2024-08-17T02:30:13.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 -- 172.21.15.110:0/1387043531 learned_addr learned my addr 172.21.15.110:0/1387043531 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1be00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f1c0adcf0 0x7f5f1c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f20e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 0x7f5f1c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 -- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 msgr2=0x7f5f1c159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 0x7f5f1c159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 -- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f1c0adcf0 msgr2=0x7f5f1c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f1c0adcf0 0x7f5f1c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 -- 172.21.15.110:0/1387043531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009390 con 0x7f5f1c156990 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f20e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 0x7f5f1c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f1b400640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009880 tx=0x7f5f08032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.695+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08031dc0 con 0x7f5f1c156990 2024-08-17T02:30:13.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.696+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08000c40 con 0x7f5f1c156990 2024-08-17T02:30:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.696+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c0c9170 con 0x7f5f1c156990 2024-08-17T02:30:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.696+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0803d670 con 0x7f5f1c156990 2024-08-17T02:30:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.696+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c0c9730 con 0x7f5f1c156990 2024-08-17T02:30:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.697+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c071050 con 0x7f5f1c156990 2024-08-17T02:30:13.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.698+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f08039040 con 0x7f5f1c156990 2024-08-17T02:30:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.699+0000 7f5f13400640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 0x7f5efc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.699+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f080a2750 con 0x7f5f1c156990 2024-08-17T02:30:13.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.699+0000 7f5f1be00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 0x7f5efc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:13.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.700+0000 7f5f1be00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 0x7f5efc067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0650d0 tx=0x7f5f0c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:13.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.703+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f08070820 con 0x7f5f1c156990 2024-08-17T02:30:13.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:13.907+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000013181", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f1c0c9be0 con 0x7f5efc065150 2024-08-17T02:30:14.154 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:14.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:16.811 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.810+0000 7f5f13400640 1 -- 172.21.15.110:0/1387043531 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f5f1c0c9be0 con 0x7f5efc065150 2024-08-17T02:30:16.811 INFO:teuthology.orchestra.run.smithi110.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:30:16.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 msgr2=0x7f5efc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:16.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 0x7f5efc067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c0650d0 tx=0x7f5f0c009040 comp rx=0 tx=0).stop 2024-08-17T02:30:16.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 msgr2=0x7f5f1c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:16.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009880 tx=0x7f5f08032000 comp rx=0 tx=0).stop 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 shutdown_connections 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5efc065150 0x7f5efc067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f1c156d60 0x7f5f1c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f1c156990 0x7f5f1c0c9f30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 --2- 172.21.15.110:0/1387043531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f1c0adcf0 0x7f5f1c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.815 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.814+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 >> 172.21.15.110:0/1387043531 conn(0x7f5f1c067750 msgr2=0x7f5f1c068ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:16.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.815+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 shutdown_connections 2024-08-17T02:30:16.816 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.816+0000 7f5f22e00640 1 -- 172.21.15.110:0/1387043531 wait complete. 2024-08-17T02:30:16.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:30:16.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.993+0000 7f84e0000640 1 Processor -- start 2024-08-17T02:30:16.994 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.993+0000 7f84e0000640 1 -- start start 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84e0000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84d8159060 0x7f84d80c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84e0000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84d8159430 0x7f84d80cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84e0000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80cbf40 con 0x7f84d80c6a30 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84e0000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d80cb930 con 0x7f84d8159430 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84e0000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d80ced10 con 0x7f84d8159060 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84d8159430 0x7f84d80cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f84d8159430 0x7f84d80cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34062/0 (socket says 172.21.15.110:34062) 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 -- 172.21.15.110:0/3812780156 learned_addr learned my addr 172.21.15.110:0/3812780156 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84dd600640 1 --2- 172.21.15.110:0/3812780156 >> v2:172.21.15.177:3300/0 conn(0x7f84d8159060 0x7f84d80c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 -- 172.21.15.110:0/3812780156 >> v2:172.21.15.177:3300/0 conn(0x7f84d8159060 msgr2=0x7f84d80c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 --2- 172.21.15.110:0/3812780156 >> v2:172.21.15.177:3300/0 conn(0x7f84d8159060 0x7f84d80c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.996 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 -- 172.21.15.110:0/3812780156 >> v1:172.21.15.177:6789/0 conn(0x7f84d80c6a30 legacy=0x7f84d80cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:16.997 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.995+0000 7f84de000640 1 -- 172.21.15.110:0/3812780156 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80cbbd0 con 0x7f84d8159430 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.996+0000 7f84de000640 1 --2- 172.21.15.110:0/3812780156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159430 0x7f84d80cb2d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f84d8065ea0 tx=0x7f84d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a474589d2d7d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84d7e00640 1 -- 172.21.15.110:0/3812780156 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0031400 con 0x7f84d8159430 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84d7e00640 1 -- 172.21.15.110:0/3812780156 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d002d050 con 0x7f84d8159430 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84d7e00640 1 -- 172.21.15.110:0/3812780156 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00317d0 con 0x7f84d8159430 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 -- 172.21.15.110:0/3812780156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159430 msgr2=0x7f84d80cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 --2- 172.21.15.110:0/3812780156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159430 0x7f84d80cb2d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f84d8065ea0 tx=0x7f84d0009840 comp rx=0 tx=0).stop 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 -- 172.21.15.110:0/3812780156 shutdown_connections 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 --2- 172.21.15.110:0/3812780156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159430 0x7f84d80cb2d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.998 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 --2- 172.21.15.110:0/3812780156 >> v2:172.21.15.177:3300/0 conn(0x7f84d8159060 0x7f84d80c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:16.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 -- 172.21.15.110:0/3812780156 >> 172.21.15.110:0/3812780156 conn(0x7f84d80cfde0 msgr2=0x7f84d80d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:16.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 -- 172.21.15.110:0/3812780156 shutdown_connections 2024-08-17T02:30:16.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.997+0000 7f84e0000640 1 -- 172.21.15.110:0/3812780156 wait complete. 2024-08-17T02:30:16.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.999+0000 7f84e0000640 1 Processor -- start 2024-08-17T02:30:16.999 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:16.999+0000 7f84e0000640 1 -- start start 2024-08-17T02:30:17.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80c6a30 0x7f84d8169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.001 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 0x7f84d809be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8169fa0 con 0x7f84d8159060 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d816c6f0 con 0x7f84d80c6a30 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84e0000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8155ef0 con 0x7f84d8159430 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34072/0 (socket says 172.21.15.110:34072) 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 -- 172.21.15.110:0/452663277 learned_addr learned my addr 172.21.15.110:0/452663277 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dd600640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80c6a30 0x7f84d8169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84de000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 0x7f84d809be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 -- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 msgr2=0x7f84d809be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.002 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 0x7f84d809be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 -- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80c6a30 msgr2=0x7f84d8169a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80c6a30 0x7f84d8169a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84dcc00640 1 -- 172.21.15.110:0/452663277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0009ae0 con 0x7f84d8159060 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.000+0000 7f84de000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 0x7f84d809be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84dcc00640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b4f0 tx=0x7f84c4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400f510 con 0x7f84d8159060 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c400f670 con 0x7f84d8159060 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d814cff0 con 0x7f84d8159060 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c400fa30 con 0x7f84d8159060 2024-08-17T02:30:17.003 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.001+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d809a910 con 0x7f84d8159060 2024-08-17T02:30:17.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.002+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d816c880 con 0x7f84d8159060 2024-08-17T02:30:17.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.003+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f84c401a400 con 0x7f84d8159060 2024-08-17T02:30:17.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.004+0000 7f84d4c00640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 0x7f84b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.004+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f84c4082260 con 0x7f84d8159060 2024-08-17T02:30:17.004 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.004+0000 7f84dd600640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 0x7f84b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.005 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.004+0000 7f84dd600640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 0x7f84b8067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84d80d10b0 tx=0x7f84cc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.008 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.008+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84c404ff80 con 0x7f84d8159060 2024-08-17T02:30:17.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.203+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f84d8063d20 con 0x7f84b8065150 2024-08-17T02:30:17.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.204+0000 7f84d4c00640 1 -- 172.21.15.110:0/452663277 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f84d8063d20 con 0x7f84b8065150 2024-08-17T02:30:17.204 INFO:teuthology.orchestra.run.smithi110.stdout:[ 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "cephfs" 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "name": "volume_0000000000013181" 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-08-17T02:30:17.205 INFO:teuthology.orchestra.run.smithi110.stdout:] 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 msgr2=0x7f84b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 0x7f84b8067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84d80d10b0 tx=0x7f84cc008040 comp rx=0 tx=0).stop 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 msgr2=0x7f84d814cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b4f0 tx=0x7f84c4009060 comp rx=0 tx=0).stop 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 shutdown_connections 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84b8065150 0x7f84b8067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84d8159430 0x7f84d809be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d8159060 0x7f84d814cab0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 --2- 172.21.15.110:0/452663277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84d80c6a30 0x7f84d8169a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 >> 172.21.15.110:0/452663277 conn(0x7f84d80cfde0 msgr2=0x7f84d80c98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:17.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 shutdown_connections 2024-08-17T02:30:17.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.206+0000 7f84e0000640 1 -- 172.21.15.110:0/452663277 wait complete. 2024-08-17T02:30:17.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:30:17.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.371+0000 7fb7b2800640 1 Processor -- start 2024-08-17T02:30:17.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.371+0000 7fb7b2800640 1 -- start start 2024-08-17T02:30:17.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.372+0000 7fb7b2800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.372 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.372+0000 7fb7b2800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac15b030 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.372+0000 7fb7b2800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0cc2e0 con 0x7fb7ac156990 2024-08-17T02:30:17.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.372+0000 7fb7b2800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac0ae0f0 con 0x7fb7ac156d60 2024-08-17T02:30:17.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34086/0 (socket says 172.21.15.110:34086) 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 -- 172.21.15.110:0/3579762762 learned_addr learned my addr 172.21.15.110:0/3579762762 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7abe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb7ac0adcf0 0x7fb7ac0ae940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:51754/0 (socket says 172.21.15.110:51754) 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 -- 172.21.15.110:0/3579762762 >> v1:172.21.15.177:6789/0 conn(0x7fb7ac156990 legacy=0x7fb7ac0b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 -- 172.21.15.110:0/3579762762 >> v1:172.21.15.110:6789/0 conn(0x7fb7ac0adcf0 legacy=0x7fb7ac0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aaa00640 1 -- 172.21.15.110:0/3579762762 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0b1110 con 0x7fb7ac156d60 2024-08-17T02:30:17.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.373+0000 7fb7aa000640 1 -- 172.21.15.110:0/3579762762 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197235291 0 0) 0x7fb7ac15b030 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.374+0000 7fb7aaa00640 1 --2- 172.21.15.110:0/3579762762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb798009910 tx=0x7fb7980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830caca05e021837 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.374+0000 7fb7aa000640 1 -- 172.21.15.110:0/3579762762 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79802ae60 con 0x7fb7ac156d60 2024-08-17T02:30:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.374+0000 7fb7aa000640 1 -- 172.21.15.110:0/3579762762 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798032440 con 0x7fb7ac156d60 2024-08-17T02:30:17.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.374+0000 7fb7aa000640 1 -- 172.21.15.110:0/3579762762 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980327e0 con 0x7fb7ac156d60 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 -- 172.21.15.110:0/3579762762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac156d60 msgr2=0x7fb7ac0ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3579762762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb798009910 tx=0x7fb7980091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 -- 172.21.15.110:0/3579762762 shutdown_connections 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3579762762 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ad7b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 -- 172.21.15.110:0/3579762762 >> 172.21.15.110:0/3579762762 conn(0x7fb7ac067750 msgr2=0x7fb7ac0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 -- 172.21.15.110:0/3579762762 shutdown_connections 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.375+0000 7fb7b2800640 1 -- 172.21.15.110:0/3579762762 wait complete. 2024-08-17T02:30:17.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.376+0000 7fb7b2800640 1 Processor -- start 2024-08-17T02:30:17.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 -- start start 2024-08-17T02:30:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7ac156990 0x7fb7ac0696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0ad600 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0ac020 con 0x7fb7ac156d60 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.377+0000 7fb7b2800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0ac300 con 0x7fb7ac156990 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34102/0 (socket says 172.21.15.110:34102) 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 -- 172.21.15.110:0/3450445365 learned_addr learned my addr 172.21.15.110:0/3450445365 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 -- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7ac156990 msgr2=0x7fb7ac0696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7ac156990 0x7fb7ac0696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 -- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7ac156d60 msgr2=0x7fb7ac0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 -- 172.21.15.110:0/3450445365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798009450 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7ab400640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c5e0 tx=0x7fb79c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c012630 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c0127b0 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.378+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac0ac5e0 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.379+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c012b70 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.379+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac0acba0 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.380+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac0acd90 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.380+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb79c01b400 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.381+0000 7fb7a2a00640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 0x7fb78c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.381+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fb79c082a30 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.381+0000 7fb7aaa00640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 0x7fb78c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.382+0000 7fb7aaa00640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 0x7fb78c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb798034000 tx=0x7fb798032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.385+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb79c0506d0 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.560+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7fb7ac071050 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.561+0000 7fb7a2a00640 1 -- 172.21.15.110:0/3450445365 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v36) v1 ==== 97+0+8050 (secure 0 0 0) 0x7fb79c0160a0 con 0x7fb7ac0adcf0 2024-08-17T02:30:17.561 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:17.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 msgr2=0x7fb78c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 0x7fb78c067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb798034000 tx=0x7fb798032000 comp rx=0 tx=0).stop 2024-08-17T02:30:17.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 msgr2=0x7fb7ac0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c5e0 tx=0x7fb79c007ed0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 shutdown_connections 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fb78c065150 0x7fb78c067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7ac156d60 0x7fb7ac0ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7ac156990 0x7fb7ac0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 --2- 172.21.15.110:0/3450445365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7ac0adcf0 0x7fb7ac0ad0c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 >> 172.21.15.110:0/3450445365 conn(0x7fb7ac067750 msgr2=0x7fb7ac1528b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 shutdown_connections 2024-08-17T02:30:17.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.563+0000 7fb7b2800640 1 -- 172.21.15.110:0/3450445365 wait complete. 2024-08-17T02:30:17.578 INFO:teuthology.orchestra.run.smithi110.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}] 2024-08-17T02:30:17.579 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000013181 --format=json 2024-08-17T02:30:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.727+0000 7fe8a3400640 1 Processor -- start 2024-08-17T02:30:17.728 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.727+0000 7fe8a3400640 1 -- start start 2024-08-17T02:30:17.729 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.728+0000 7fe8a3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe89c06da20 0x7fe89c06ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a3400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe89c158fa0 0x7fe89c0ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a3400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0a9a10 con 0x7fe89c0aa7d0 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a3400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0ac400 con 0x7fe89c06da20 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a3400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0a9cf0 con 0x7fe89c158fa0 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe89c06da20 0x7fe89c06ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe89c06da20 0x7fe89c06ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34116/0 (socket says 172.21.15.110:34116) 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 -- 172.21.15.110:0/1796835369 learned_addr learned my addr 172.21.15.110:0/1796835369 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a1400640 1 --2- 172.21.15.110:0/1796835369 >> v2:172.21.15.177:3300/0 conn(0x7fe89c158fa0 0x7fe89c0ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 -- 172.21.15.110:0/1796835369 >> v2:172.21.15.177:3300/0 conn(0x7fe89c158fa0 msgr2=0x7fe89c0ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 --2- 172.21.15.110:0/1796835369 >> v2:172.21.15.177:3300/0 conn(0x7fe89c158fa0 0x7fe89c0ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.730 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 -- 172.21.15.110:0/1796835369 >> v1:172.21.15.177:6789/0 conn(0x7fe89c0aa7d0 legacy=0x7fe89c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:17.731 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.729+0000 7fe8a0a00640 1 -- 172.21.15.110:0/1796835369 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0a9fd0 con 0x7fe89c06da20 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.730+0000 7fe8a0a00640 1 --2- 172.21.15.110:0/1796835369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c06da20 0x7fe89c06ddf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0ad2e0 tx=0x7fe88c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d0ab67c4082760 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe89be00640 1 -- 172.21.15.110:0/1796835369 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c02adf0 con 0x7fe89c06da20 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe89be00640 1 -- 172.21.15.110:0/1796835369 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c032440 con 0x7fe89c06da20 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe89be00640 1 -- 172.21.15.110:0/1796835369 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c032820 con 0x7fe89c06da20 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 -- 172.21.15.110:0/1796835369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c06da20 msgr2=0x7fe89c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 --2- 172.21.15.110:0/1796835369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c06da20 0x7fe89c06ddf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0ad2e0 tx=0x7fe88c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 -- 172.21.15.110:0/1796835369 shutdown_connections 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 --2- 172.21.15.110:0/1796835369 >> v2:172.21.15.177:3300/0 conn(0x7fe89c158fa0 0x7fe89c0ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 --2- 172.21.15.110:0/1796835369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c06da20 0x7fe89c06ddf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 -- 172.21.15.110:0/1796835369 >> 172.21.15.110:0/1796835369 conn(0x7fe89c0cb9b0 msgr2=0x7fe89c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 -- 172.21.15.110:0/1796835369 shutdown_connections 2024-08-17T02:30:17.732 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.731+0000 7fe8a3400640 1 -- 172.21.15.110:0/1796835369 wait complete. 2024-08-17T02:30:17.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.733+0000 7fe8a3400640 1 Processor -- start 2024-08-17T02:30:17.733 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.733+0000 7fe8a3400640 1 -- start start 2024-08-17T02:30:17.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c06da20 0x7fe89c150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe89c0aa7d0 0x7fe89c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.735 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15ae10 con 0x7fe89c158fa0 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15a200 con 0x7fe89c06da20 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15a4e0 con 0x7fe89c0aa7d0 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34120/0 (socket says 172.21.15.110:34120) 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a1400640 1 -- 172.21.15.110:0/839761640 learned_addr learned my addr 172.21.15.110:0/839761640 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a0a00640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c06da20 0x7fe89c150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe893e00640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe89c0aa7d0 0x7fe89c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a1400640 1 -- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe89c0aa7d0 msgr2=0x7fe89c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.734+0000 7fe8a1400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe89c0aa7d0 0x7fe89c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a1400640 1 -- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c06da20 msgr2=0x7fe89c150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.736 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a1400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c06da20 0x7fe89c150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a1400640 1 -- 172.21.15.110:0/839761640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009450 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a1400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe894007f20 tx=0x7fe894009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400ee30 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894014420 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c15a7c0 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940147e0 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.735+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c1513a0 con 0x7fe89c158fa0 2024-08-17T02:30:17.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.736+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c15af80 con 0x7fe89c158fa0 2024-08-17T02:30:17.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.737+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe894014b50 con 0x7fe89c158fa0 2024-08-17T02:30:17.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.738+0000 7fe898c00640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 0x7fe878067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:17.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.738+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe894082e70 con 0x7fe89c158fa0 2024-08-17T02:30:17.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.738+0000 7fe8a0a00640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 0x7fe878067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:17.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.739+0000 7fe8a0a00640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 0x7fe878067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034000 tx=0x7fe88c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:17.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.742+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe894050bc0 con 0x7fe89c158fa0 2024-08-17T02:30:17.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.963+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000013181", "format": "json"} v 0) v1 -- 0x7fe89c064db0 con 0x7fe89c158fa0 2024-08-17T02:30:17.964 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.964+0000 7fe898c00640 1 -- 172.21.15.110:0/839761640 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000013181", "format": "json"}]=0 v21) v1 ==== 110+0+1847 (secure 0 0 0) 0x7fe8940541e0 con 0x7fe89c158fa0 2024-08-17T02:30:17.964 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:30:17.964 INFO:teuthology.orchestra.run.smithi110.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 msgr2=0x7fe878067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 0x7fe878067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe88c034000 tx=0x7fe88c032000 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 msgr2=0x7fe89c0ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe894007f20 tx=0x7fe894009860 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 shutdown_connections 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe878065150 0x7fe878067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c158fa0 0x7fe89c0ca3e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe89c0aa7d0 0x7fe89c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 --2- 172.21.15.110:0/839761640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe89c06da20 0x7fe89c150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 >> 172.21.15.110:0/839761640 conn(0x7fe89c0cb9b0 msgr2=0x7fe89c068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 shutdown_connections 2024-08-17T02:30:17.967 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:17.966+0000 7fe8a3400640 1 -- 172.21.15.110:0/839761640 wait complete. 2024-08-17T02:30:17.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000013181 --yes-i-really-mean-it 2024-08-17T02:30:18.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.132+0000 7f9096800640 1 Processor -- start 2024-08-17T02:30:18.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.132+0000 7f9096800640 1 -- start start 2024-08-17T02:30:18.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.133+0000 7f9096800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f90900c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.133+0000 7f9096800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 0x7f90900c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.133+0000 7f9096800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90900c9570 con 0x7f90900adcf0 2024-08-17T02:30:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.133+0000 7f9096800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90900ab130 con 0x7f90900c8bd0 2024-08-17T02:30:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.133+0000 7f9096800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900ae5a0 con 0x7f9090156c50 2024-08-17T02:30:18.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.134+0000 7f908fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 0x7f90900c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.134+0000 7f908f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f90900c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.134+0000 7f908ea00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f90900adcf0 0x7f90900ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:56960/0 (socket says 172.21.15.110:56960) 2024-08-17T02:30:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.134+0000 7f908ea00640 1 -- 172.21.15.110:0/1408478087 learned_addr learned my addr 172.21.15.110:0/1408478087 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:30:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908e000640 1 -- 172.21.15.110:0/1408478087 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722914579 0 0) 0x7f907c001110 con 0x7f90900adcf0 2024-08-17T02:30:18.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908e000640 1 -- 172.21.15.110:0/1408478087 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90740034e0 con 0x7f90900adcf0 2024-08-17T02:30:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908f400640 1 -- 172.21.15.110:0/1408478087 >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 msgr2=0x7f90900c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:30:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908f400640 1 --2- 172.21.15.110:0/1408478087 >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 0x7f90900c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908f400640 1 -- 172.21.15.110:0/1408478087 >> v1:172.21.15.177:6789/0 conn(0x7f90900adcf0 legacy=0x7f90900ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908f400640 1 -- 172.21.15.110:0/1408478087 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90900ae2c0 con 0x7f9090156c50 2024-08-17T02:30:18.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.135+0000 7f908fe00640 1 --2- 172.21.15.110:0/1408478087 >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 0x7f90900c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.136+0000 7f908f400640 1 --2- 172.21.15.110:0/1408478087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f90900c7cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9080009850 tx=0x7f90800090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b13dc5d9daf1b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.136+0000 7f908e000640 1 -- 172.21.15.110:0/1408478087 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908002ad00 con 0x7f9090156c50 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.136+0000 7f908e000640 1 -- 172.21.15.110:0/1408478087 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908002ae60 con 0x7f9090156c50 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.136+0000 7f908e000640 1 -- 172.21.15.110:0/1408478087 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080032650 con 0x7f9090156c50 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 -- 172.21.15.110:0/1408478087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 msgr2=0x7f90900c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:18.137 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 --2- 172.21.15.110:0/1408478087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f90900c7cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9080009850 tx=0x7f90800090f0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 -- 172.21.15.110:0/1408478087 shutdown_connections 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 --2- 172.21.15.110:0/1408478087 >> v2:172.21.15.177:3300/0 conn(0x7f90900c8bd0 0x7f90900c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 --2- 172.21.15.110:0/1408478087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f90900c7cf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 -- 172.21.15.110:0/1408478087 >> 172.21.15.110:0/1408478087 conn(0x7f9090067750 msgr2=0x7f90900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 -- 172.21.15.110:0/1408478087 shutdown_connections 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.137+0000 7f9096800640 1 -- 172.21.15.110:0/1408478087 wait complete. 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.138+0000 7f9096800640 1 Processor -- start 2024-08-17T02:30:18.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.138+0000 7f9096800640 1 -- start start 2024-08-17T02:30:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90900adcf0 0x7f909016d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90900c8bd0 0x7f90901493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f9090069e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006c7c0 con 0x7f90900adcf0 2024-08-17T02:30:18.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909006d340 con 0x7f90900c8bd0 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f9096800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909006ca10 con 0x7f9090156c50 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.139+0000 7f908f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90900adcf0 0x7f909016d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90900adcf0 0x7f909016d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:34136/0 (socket says 172.21.15.110:34136) 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 -- 172.21.15.110:0/903275649 learned_addr learned my addr 172.21.15.110:0/903275649 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908ea00640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90900c8bd0 0x7f90901493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908fe00640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f9090069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 -- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 msgr2=0x7f9090069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9090156c50 0x7f9090069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 -- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90900c8bd0 msgr2=0x7f90901493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90900c8bd0 0x7f90901493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:30:18.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 -- 172.21.15.110:0/903275649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009a20 con 0x7f90900adcf0 2024-08-17T02:30:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.140+0000 7f908f400640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90900adcf0 0x7f909016d020 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f90800098b0 tx=0x7f9080032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.141+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908003c6f0 con 0x7f90900adcf0 2024-08-17T02:30:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.141+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908003c850 con 0x7f90900adcf0 2024-08-17T02:30:18.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.141+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908003cbf0 con 0x7f90900adcf0 2024-08-17T02:30:18.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.141+0000 7f9096800640 1 -- 172.21.15.110:0/903275649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9080009390 con 0x7f90900adcf0 2024-08-17T02:30:18.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.141+0000 7f9096800640 1 -- 172.21.15.110:0/903275649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909006cfd0 con 0x7f90900adcf0 2024-08-17T02:30:18.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.142+0000 7f9096800640 1 -- 172.21.15.110:0/903275649 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9090071050 con 0x7f90900adcf0 2024-08-17T02:30:18.143 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.143+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9080039050 con 0x7f90900adcf0 2024-08-17T02:30:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.143+0000 7f9086a00640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9070065150 0x7f9070067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:30:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.143+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f90800a2ba0 con 0x7f90900adcf0 2024-08-17T02:30:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.144+0000 7f908ea00640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9070065150 0x7f9070067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:30:18.144 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.144+0000 7f908ea00640 1 --2- 172.21.15.110:0/903275649 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9070065150 0x7f9070067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f907c001270 tx=0x7f907c000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:30:18.147 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.147+0000 7f9086a00640 1 -- 172.21.15.110:0/903275649 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9080070a50 con 0x7f90900adcf0 2024-08-17T02:30:18.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:30:18.342+0000 7f9096800640 1 -- 172.21.15.110:0/903275649 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000013181", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f909006d480 con 0x7f9070065150 2024-08-17T02:30:22.684 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-08-17T02:30:22.683+0000 7fa65de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:30:44.251 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:30:44.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:14.358 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:14.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:44.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:31:44.670 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:32:14.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:32:14.773 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:32:18.051 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:32:18.052 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:32:18.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:32:18.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:32:18.221 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:32:18.222 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:32:18.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:32:18.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:32:18.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:32:18.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:18.288 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:32:18.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:32:18.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:32:18.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:32:18.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:32:18.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:18.392 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:32:18.428 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:18.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.576+0000 7f87f5e00640 1 Processor -- start 2024-08-17T02:32:18.577 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.576+0000 7f87f5e00640 1 -- start start 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.577+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.577+0000 7f87f5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87f006df00 0x7f87f00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.577+0000 7f87f5e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f0156670 con 0x7f87f0155df0 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.577+0000 7f87f5e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00b0350 con 0x7f87f006df00 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.577+0000 7f87f5e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f006e5e0 con 0x7f87f0155a20 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87f006df00 0x7f87f00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87f006df00 0x7f87f00ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50460/0 (socket says 172.21.15.110:50460) 2024-08-17T02:32:18.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 -- 172.21.15.110:0/1807659211 learned_addr learned my addr 172.21.15.110:0/1807659211 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87eea00640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 -- 172.21.15.110:0/1807659211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 msgr2=0x7f87f00adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f00adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 -- 172.21.15.110:0/1807659211 >> v1:172.21.15.177:6789/0 conn(0x7f87f0155df0 legacy=0x7f87f006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87ef400640 1 -- 172.21.15.110:0/1807659211 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f006e8c0 con 0x7f87f006df00 2024-08-17T02:32:18.580 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.578+0000 7f87eea00640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.579+0000 7f87ef400640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f006df00 0x7f87f00ad9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f20 tx=0x7f87e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf4015a5b3c7242 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.579+0000 7f87ee000640 1 -- 172.21.15.110:0/1807659211 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8031400 con 0x7f87f006df00 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.579+0000 7f87ee000640 1 -- 172.21.15.110:0/1807659211 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e802d050 con 0x7f87f006df00 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87ee000640 1 -- 172.21.15.110:0/1807659211 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80317d0 con 0x7f87f006df00 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 -- 172.21.15.110:0/1807659211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f006df00 msgr2=0x7f87f00ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.581 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f006df00 0x7f87f00ad9b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f20 tx=0x7f87e8009840 comp rx=0 tx=0).stop 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 -- 172.21.15.110:0/1807659211 shutdown_connections 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f006df00 0x7f87f00ad9b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 --2- 172.21.15.110:0/1807659211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f00adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 -- 172.21.15.110:0/1807659211 >> 172.21.15.110:0/1807659211 conn(0x7f87f00cb9b0 msgr2=0x7f87f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 -- 172.21.15.110:0/1807659211 shutdown_connections 2024-08-17T02:32:18.582 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.580+0000 7f87f5e00640 1 -- 172.21.15.110:0/1807659211 wait complete. 2024-08-17T02:32:18.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.581+0000 7f87f5e00640 1 Processor -- start 2024-08-17T02:32:18.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 -- start start 2024-08-17T02:32:18.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87f006df00 0x7f87f0149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.584 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f01495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f016c900 con 0x7f87f0155df0 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f016cbe0 con 0x7f87f006df00 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.582+0000 7f87f5e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f016cec0 con 0x7f87f0155a20 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50464/0 (socket says 172.21.15.110:50464) 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 -- 172.21.15.110:0/600562244 learned_addr learned my addr 172.21.15.110:0/600562244 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87eea00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87f006df00 0x7f87f0149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87e6000640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f01495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 -- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 msgr2=0x7f87f01495f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f01495f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 -- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87f006df00 msgr2=0x7f87f0149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87f006df00 0x7f87f0149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 -- 172.21.15.110:0/600562244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8009ae0 con 0x7f87f0155df0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.583+0000 7f87ef400640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f80 tx=0x7f87e8036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.584+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8007170 con 0x7f87f0155df0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.584+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8008e50 con 0x7f87f0155df0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.584+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e803b640 con 0x7f87f0155df0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.584+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f016d1a0 con 0x7f87f0155df0 2024-08-17T02:32:18.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.584+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f016c520 con 0x7f87f0155df0 2024-08-17T02:32:18.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.585+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f0064db0 con 0x7f87f0155df0 2024-08-17T02:32:18.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.585+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f87e8038050 con 0x7f87f0155df0 2024-08-17T02:32:18.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.586+0000 7f87e6a00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 0x7f87cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.586+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f87e80a3480 con 0x7f87f0155df0 2024-08-17T02:32:18.587 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.587+0000 7f87eea00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 0x7f87cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.588 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.587+0000 7f87eea00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 0x7f87cc067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006e70 tx=0x7f87e0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.591 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.591+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f87e8071120 con 0x7f87f0155df0 2024-08-17T02:32:18.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.801+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f0156e40 con 0x7f87f0155df0 2024-08-17T02:32:18.802 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.802+0000 7f87e6a00640 1 -- 172.21.15.110:0/600562244 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5696 (secure 0 0 0) 0x7f87e8074740 con 0x7f87f0155df0 2024-08-17T02:32:18.803 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:18.803 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:18.803 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 21 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 msgr2=0x7f87cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 0x7f87cc067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f87e0006e70 tx=0x7f87e0008040 comp rx=0 tx=0).stop 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 msgr2=0x7f87f014c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009f80 tx=0x7f87e8036000 comp rx=0 tx=0).stop 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 shutdown_connections 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f87cc065150 0x7f87cc067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.805 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87f0155df0 0x7f87f014c4b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87f0155a20 0x7f87f01495f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 --2- 172.21.15.110:0/600562244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87f006df00 0x7f87f0149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 >> 172.21.15.110:0/600562244 conn(0x7f87f00cb9b0 msgr2=0x7f87f00adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 shutdown_connections 2024-08-17T02:32:18.806 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.804+0000 7f87f5e00640 1 -- 172.21.15.110:0/600562244 wait complete. 2024-08-17T02:32:18.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:18.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.967+0000 7fac5bc00640 1 Processor -- start 2024-08-17T02:32:18.968 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.967+0000 7fac5bc00640 1 -- start start 2024-08-17T02:32:18.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac5bc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac541401b0 0x7fac540caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac5bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac540b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.969 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac5bc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540b16d0 con 0x7fac540b1270 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac5bc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac540cb450 con 0x7fac541401b0 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac5bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac540caa80 con 0x7fac54140580 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac541401b0 0x7fac540caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac541401b0 0x7fac540caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50472/0 (socket says 172.21.15.110:50472) 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 -- 172.21.15.110:0/1353059222 learned_addr learned my addr 172.21.15.110:0/1353059222 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59c00640 1 --1- 172.21.15.110:0/1353059222 >> v1:172.21.15.110:6789/0 conn(0x7fac540b1270 0x7fac540c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37238/0 (socket says 172.21.15.110:37238) 2024-08-17T02:32:18.970 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac4be00640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac540b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 -- 172.21.15.110:0/1353059222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 msgr2=0x7fac540b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac540b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 -- 172.21.15.110:0/1353059222 >> v1:172.21.15.110:6789/0 conn(0x7fac540b1270 legacy=0x7fac540c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac59200640 1 -- 172.21.15.110:0/1353059222 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540c9e70 con 0x7fac541401b0 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.969+0000 7fac4be00640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac540b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.970+0000 7fac59200640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac541401b0 0x7fac540caf10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fac44009910 tx=0x7fac440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4851d33cc6fd9fc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.971 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac53e00640 1 -- 172.21.15.110:0/1353059222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4402add0 con 0x7fac541401b0 2024-08-17T02:32:18.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac53e00640 1 -- 172.21.15.110:0/1353059222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44032440 con 0x7fac541401b0 2024-08-17T02:32:18.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac53e00640 1 -- 172.21.15.110:0/1353059222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44032820 con 0x7fac541401b0 2024-08-17T02:32:18.972 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 -- 172.21.15.110:0/1353059222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac541401b0 msgr2=0x7fac540caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac541401b0 0x7fac540caf10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fac44009910 tx=0x7fac440091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 -- 172.21.15.110:0/1353059222 shutdown_connections 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac540b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 --2- 172.21.15.110:0/1353059222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac541401b0 0x7fac540caf10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.971+0000 7fac5bc00640 1 -- 172.21.15.110:0/1353059222 >> 172.21.15.110:0/1353059222 conn(0x7fac540cb9b0 msgr2=0x7fac540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.972+0000 7fac5bc00640 1 -- 172.21.15.110:0/1353059222 shutdown_connections 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.972+0000 7fac5bc00640 1 -- 172.21.15.110:0/1353059222 wait complete. 2024-08-17T02:32:18.973 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.973+0000 7fac5bc00640 1 Processor -- start 2024-08-17T02:32:18.974 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.973+0000 7fac5bc00640 1 -- start start 2024-08-17T02:32:18.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac541401b0 0x7fac54166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac54167420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415a8a0 con 0x7fac540b1270 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415a270 con 0x7fac541401b0 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac5bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac54167a60 con 0x7fac54140580 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50486/0 (socket says 172.21.15.110:50486) 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 -- 172.21.15.110:0/3934657707 learned_addr learned my addr 172.21.15.110:0/3934657707 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59c00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac54167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac4be00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac541401b0 0x7fac54166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 -- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 msgr2=0x7fac54167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac54167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 -- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac541401b0 msgr2=0x7fac54166ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac541401b0 0x7fac54166ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.974+0000 7fac59200640 1 -- 172.21.15.110:0/3934657707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44009450 con 0x7fac540b1270 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac59200640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac44035040 tx=0x7fac44032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44000c90 con 0x7fac540b1270 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac44031a40 con 0x7fac540b1270 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac44031e00 con 0x7fac540b1270 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac54167d40 con 0x7fac540b1270 2024-08-17T02:32:18.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.975+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5413e600 con 0x7fac540b1270 2024-08-17T02:32:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.976+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac54064db0 con 0x7fac540b1270 2024-08-17T02:32:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.977+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac44039040 con 0x7fac540b1270 2024-08-17T02:32:18.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.978+0000 7fac50c00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 0x7fac30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.978+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fac440a2490 con 0x7fac540b1270 2024-08-17T02:32:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.978+0000 7fac4be00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 0x7fac30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:18.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.979+0000 7fac4be00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 0x7fac30067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac3c006e70 tx=0x7fac3c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:18.982 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:18.982+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fac44070130 con 0x7fac540b1270 2024-08-17T02:32:19.158 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.158+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac540add00 con 0x7fac540b1270 2024-08-17T02:32:19.159 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.159+0000 7fac50c00640 1 -- 172.21.15.110:0/3934657707 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fac44073750 con 0x7fac540b1270 2024-08-17T02:32:19.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:19.160 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:30:18.807133+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 msgr2=0x7fac30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 0x7fac30067600 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fac3c006e70 tx=0x7fac3c008040 comp rx=0 tx=0).stop 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 msgr2=0x7fac540abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fac44035040 tx=0x7fac44032000 comp rx=0 tx=0).stop 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 shutdown_connections 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fac30065150 0x7fac30067600 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac54140580 0x7fac54167420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.162 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac541401b0 0x7fac54166ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 --2- 172.21.15.110:0/3934657707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac540b1270 0x7fac540abb50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 >> 172.21.15.110:0/3934657707 conn(0x7fac540cb9b0 msgr2=0x7fac5406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:19.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 shutdown_connections 2024-08-17T02:32:19.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.161+0000 7fac5bc00640 1 -- 172.21.15.110:0/3934657707 wait complete. 2024-08-17T02:32:19.177 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:29:56.090122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:29:57.105839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000013181.meta', 'create_time': '2024-08-17T02:30:13.947037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000013181'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000013181.data', 'create_time': '2024-08-17T02:30:14.843060+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000013181'}}}] 2024-08-17T02:32:19.177 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:32:19.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.327+0000 7f6064e00640 1 Processor -- start 2024-08-17T02:32:19.328 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.328+0000 7f6064e00640 1 -- start start 2024-08-17T02:32:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.329+0000 7f6064e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6060154770 0x7f60600cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.329+0000 7f6064e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 0x7f6060157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.329 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.329+0000 7f6064e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6060157eb0 con 0x7f60601543a0 2024-08-17T02:32:19.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.329+0000 7f6064e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600ca160 con 0x7f6060154770 2024-08-17T02:32:19.330 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.329+0000 7f6064e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60600ca440 con 0x7f606006e3e0 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 0x7f6060157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f6056a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6060154770 0x7f60600cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605f400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f60601543a0 0x7f606006dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:60774/0 (socket says 172.21.15.110:60774) 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605f400640 1 -- 172.21.15.110:0/3544699356 learned_addr learned my addr 172.21.15.110:0/3544699356 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605ea00640 1 -- 172.21.15.110:0/3544699356 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812109193 0 0) 0x7f6060157eb0 con 0x7f60601543a0 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605ea00640 1 -- 172.21.15.110:0/3544699356 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60440034e0 con 0x7f60601543a0 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f6056a00640 1 -- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 msgr2=0x7f6060157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:19.331 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f6056a00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 0x7f6060157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f6056a00640 1 -- 172.21.15.110:0/3544699356 >> v1:172.21.15.177:6789/0 conn(0x7f60601543a0 legacy=0x7f606006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f6056a00640 1 -- 172.21.15.110:0/3544699356 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600ca720 con 0x7f6060154770 2024-08-17T02:32:19.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.330+0000 7f605fe00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 0x7f6060157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.331+0000 7f6056a00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060154770 0x7f60600cb200 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6048009850 tx=0x7f60480090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d30262de374bd8c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.331+0000 7f605ea00640 1 -- 172.21.15.110:0/3544699356 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604802ad80 con 0x7f6060154770 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.331+0000 7f605ea00640 1 -- 172.21.15.110:0/3544699356 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6048032440 con 0x7f6060154770 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.331+0000 7f605ea00640 1 -- 172.21.15.110:0/3544699356 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6048032820 con 0x7f6060154770 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 -- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060154770 msgr2=0x7f60600cb200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.333 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060154770 0x7f60600cb200 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6048009850 tx=0x7f60480090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 -- 172.21.15.110:0/3544699356 shutdown_connections 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f606006e3e0 0x7f6060157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 --2- 172.21.15.110:0/3544699356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6060154770 0x7f60600cb200 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 -- 172.21.15.110:0/3544699356 >> 172.21.15.110:0/3544699356 conn(0x7f6060067750 msgr2=0x7f606006c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 -- 172.21.15.110:0/3544699356 shutdown_connections 2024-08-17T02:32:19.334 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.332+0000 7f6064e00640 1 -- 172.21.15.110:0/3544699356 wait complete. 2024-08-17T02:32:19.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.334+0000 7f6064e00640 1 Processor -- start 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.334+0000 7f6064e00640 1 -- start start 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f606006e3e0 0x7f60601525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60601543a0 0x7f60601492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60600af640 con 0x7f6060154770 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6060153a70 con 0x7f606006e3e0 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6064e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6060152e60 con 0x7f60601543a0 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50492/0 (socket says 172.21.15.110:50492) 2024-08-17T02:32:19.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 -- 172.21.15.110:0/1472464107 learned_addr learned my addr 172.21.15.110:0/1472464107 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f6056a00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60601543a0 0x7f60601492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605f400640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f606006e3e0 0x7f60601525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 -- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60601543a0 msgr2=0x7f60601492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60601543a0 0x7f60601492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 -- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f606006e3e0 msgr2=0x7f60601525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f606006e3e0 0x7f60601525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.335+0000 7f605fe00640 1 -- 172.21.15.110:0/1472464107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058009a20 con 0x7f6060154770 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f605fe00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6058009f60 tx=0x7f605800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800ce10 con 0x7f6060154770 2024-08-17T02:32:19.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605800f040 con 0x7f6060154770 2024-08-17T02:32:19.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580146d0 con 0x7f6060154770 2024-08-17T02:32:19.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6048009390 con 0x7f6060154770 2024-08-17T02:32:19.339 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.336+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6060153420 con 0x7f6060154770 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.337+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6060071050 con 0x7f6060154770 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.338+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6058014a40 con 0x7f6060154770 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.339+0000 7f6057400640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 0x7f603c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.339+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6058083560 con 0x7f6060154770 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.339+0000 7f605f400640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 0x7f603c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.340 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.339+0000 7f605f400640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 0x7f603c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6050001200 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.343+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6058051350 con 0x7f6060154770 2024-08-17T02:32:19.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.513+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60600b0f30 con 0x7f6060154770 2024-08-17T02:32:19.514 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.513+0000 7f6057400640 1 -- 172.21.15.110:0/1472464107 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6058054970 con 0x7f6060154770 2024-08-17T02:32:19.514 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:32:19.516 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.515+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 msgr2=0x7f603c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.515+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 0x7f603c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6050001200 tx=0x7f6050009040 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.515+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 msgr2=0x7f606006d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.515+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6058009f60 tx=0x7f605800b040 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 shutdown_connections 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f603c065150 0x7f603c067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060154770 0x7f606006d730 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60601543a0 0x7f60601492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 --2- 172.21.15.110:0/1472464107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f606006e3e0 0x7f60601525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 >> 172.21.15.110:0/1472464107 conn(0x7f6060067750 msgr2=0x7f6060156080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 shutdown_connections 2024-08-17T02:32:19.517 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.516+0000 7f6064e00640 1 -- 172.21.15.110:0/1472464107 wait complete. 2024-08-17T02:32:19.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:32:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.679+0000 7ffa86000640 1 Processor -- start 2024-08-17T02:32:19.680 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.680+0000 7ffa86000640 1 -- start start 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa800abef0 0x7ffa800accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa800ad210 0x7ffa8006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa8015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa80156e60 con 0x7ffa800abef0 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa800c95e0 con 0x7ffa800ad210 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa86000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800ad660 con 0x7ffa8006d930 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa84c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa800abef0 0x7ffa800accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa84c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffa800abef0 0x7ffa800accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50504/0 (socket says 172.21.15.110:50504) 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa84c00640 1 -- 172.21.15.110:0/445871907 learned_addr learned my addr 172.21.15.110:0/445871907 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:19.682 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa77e00640 1 --2- 172.21.15.110:0/445871907 >> v2:172.21.15.177:3300/0 conn(0x7ffa800ad210 0x7ffa8006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.681+0000 7ffa85600640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa8015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 -- 172.21.15.110:0/445871907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 msgr2=0x7ffa8015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa8015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 -- 172.21.15.110:0/445871907 >> v2:172.21.15.177:3300/0 conn(0x7ffa800ad210 msgr2=0x7ffa8006d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 --2- 172.21.15.110:0/445871907 >> v2:172.21.15.177:3300/0 conn(0x7ffa800ad210 0x7ffa8006d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.683 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 -- 172.21.15.110:0/445871907 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa800ac2c0 con 0x7ffa800abef0 2024-08-17T02:32:19.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.682+0000 7ffa84c00640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800abef0 0x7ffa800accd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffa8006bfd0 tx=0x7ffa700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f5fef3b0955558 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa7fe00640 1 -- 172.21.15.110:0/445871907 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7002add0 con 0x7ffa800abef0 2024-08-17T02:32:19.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa7fe00640 1 -- 172.21.15.110:0/445871907 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70032440 con 0x7ffa800abef0 2024-08-17T02:32:19.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa7fe00640 1 -- 172.21.15.110:0/445871907 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70032820 con 0x7ffa800abef0 2024-08-17T02:32:19.684 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 -- 172.21.15.110:0/445871907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800abef0 msgr2=0x7ffa800accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800abef0 0x7ffa800accd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ffa8006bfd0 tx=0x7ffa700091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 -- 172.21.15.110:0/445871907 shutdown_connections 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa8015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 --2- 172.21.15.110:0/445871907 >> v2:172.21.15.177:3300/0 conn(0x7ffa800ad210 0x7ffa8006d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 --2- 172.21.15.110:0/445871907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800abef0 0x7ffa800accd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 -- 172.21.15.110:0/445871907 >> 172.21.15.110:0/445871907 conn(0x7ffa80066cd0 msgr2=0x7ffa800670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.683+0000 7ffa86000640 1 -- 172.21.15.110:0/445871907 shutdown_connections 2024-08-17T02:32:19.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.684+0000 7ffa86000640 1 -- 172.21.15.110:0/445871907 wait complete. 2024-08-17T02:32:19.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.685+0000 7ffa86000640 1 Processor -- start 2024-08-17T02:32:19.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.685+0000 7ffa86000640 1 -- start start 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa800ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa800abef0 0x7ffa800ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800afdd0 con 0x7ffa800ad210 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800af1c0 con 0x7ffa800abef0 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa86000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa800af4a0 con 0x7ffa8006d930 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa85600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa85600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50520/0 (socket says 172.21.15.110:50520) 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa85600640 1 -- 172.21.15.110:0/864823826 learned_addr learned my addr 172.21.15.110:0/864823826 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa84c00640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa800ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.686+0000 7ffa77e00640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa800abef0 0x7ffa800ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 -- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 msgr2=0x7ffa800ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa800ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 -- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa800abef0 msgr2=0x7ffa800ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa800abef0 0x7ffa800ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 -- 172.21.15.110:0/864823826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009450 con 0x7ffa800ad210 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa85600640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009fa0 tx=0x7ffa78009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7800ee60 con 0x7ffa800ad210 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78014420 con 0x7ffa800ad210 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780147e0 con 0x7ffa800ad210 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa800af780 con 0x7ffa800ad210 2024-08-17T02:32:19.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.687+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa800aba40 con 0x7ffa800ad210 2024-08-17T02:32:19.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.689+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa800aff40 con 0x7ffa800ad210 2024-08-17T02:32:19.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.689+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa78014b50 con 0x7ffa800ad210 2024-08-17T02:32:19.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.691+0000 7ffa7cc00640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 0x7ffa5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:19.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.691+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ffa78082f60 con 0x7ffa800ad210 2024-08-17T02:32:19.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.691+0000 7ffa84c00640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 0x7ffa5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:19.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.691+0000 7ffa84c00640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 0x7ffa5c067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa70034000 tx=0x7ffa70032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:19.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.695+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ffa78050cb0 con 0x7ffa800ad210 2024-08-17T02:32:19.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.866+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa80071050 con 0x7ffa800ad210 2024-08-17T02:32:19.867 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.867+0000 7ffa7cc00640 1 -- 172.21.15.110:0/864823826 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa780542d0 con 0x7ffa800ad210 2024-08-17T02:32:19.868 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:32:19.869 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 msgr2=0x7ffa5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 0x7ffa5c067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffa70034000 tx=0x7ffa70032000 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 msgr2=0x7ffa80150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009fa0 tx=0x7ffa78009900 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 shutdown_connections 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ffa5c065150 0x7ffa5c067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa800ad210 0x7ffa80150c00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa800abef0 0x7ffa800ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 --2- 172.21.15.110:0/864823826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa8006d930 0x7ffa800ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 >> 172.21.15.110:0/864823826 conn(0x7ffa80066cd0 msgr2=0x7ffa80156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 shutdown_connections 2024-08-17T02:32:19.870 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:19.869+0000 7ffa86000640 1 -- 172.21.15.110:0/864823826 wait complete. 2024-08-17T02:32:19.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:32:20.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.034+0000 7f196b200640 1 Processor -- start 2024-08-17T02:32:20.035 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.034+0000 7f196b200640 1 -- start start 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f196b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f196c155a30 0x7f196c06dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f196b200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0afc40 con 0x7f196c155660 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f196b200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0af030 con 0x7f196c0adfb0 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f196b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0af310 con 0x7f196c155a30 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f1969e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f196c155660 0x7f196c0c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37242/0 (socket says 172.21.15.110:37242) 2024-08-17T02:32:20.036 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f1969e00640 1 -- 172.21.15.110:0/1165808718 learned_addr learned my addr 172.21.15.110:0/1165808718 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:20.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f196a800640 1 --2- 172.21.15.110:0/1165808718 >> v2:172.21.15.177:3300/0 conn(0x7f196c155a30 0x7f196c06dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980268564 0 0) 0x7f196c0afc40 con 0x7f196c155660 2024-08-17T02:32:20.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.036+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19500034e0 con 0x7f196c155660 2024-08-17T02:32:20.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.037+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906745648 0 0) 0x7f19500034e0 con 0x7f196c155660 2024-08-17T02:32:20.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.037+0000 7f196a800640 1 -- 172.21.15.110:0/1165808718 >> v1:172.21.15.177:6789/0 conn(0x7f196c0adfb0 legacy=0x7f196c0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.037+0000 7f196a800640 1 -- 172.21.15.110:0/1165808718 >> v1:172.21.15.110:6789/0 conn(0x7f196c155660 legacy=0x7f196c0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.037+0000 7f196a800640 1 -- 172.21.15.110:0/1165808718 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0af5f0 con 0x7f196c155a30 2024-08-17T02:32:20.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.038+0000 7f196a800640 1 --2- 172.21.15.110:0/1165808718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c155a30 0x7f196c06dec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e60 tx=0x7f1964009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abec13970046ac30 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.038+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c001470 con 0x7f196c155a30 2024-08-17T02:32:20.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.038+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196402d050 con 0x7f196c155a30 2024-08-17T02:32:20.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.038+0000 7f1969400640 1 -- 172.21.15.110:0/1165808718 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964031630 con 0x7f196c155a30 2024-08-17T02:32:20.039 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 -- 172.21.15.110:0/1165808718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c155a30 msgr2=0x7f196c06dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 --2- 172.21.15.110:0/1165808718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c155a30 0x7f196c06dec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1964009e60 tx=0x7f1964009780 comp rx=0 tx=0).stop 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 -- 172.21.15.110:0/1165808718 shutdown_connections 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 --2- 172.21.15.110:0/1165808718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c155a30 0x7f196c06dec0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 -- 172.21.15.110:0/1165808718 >> 172.21.15.110:0/1165808718 conn(0x7f196c066cd0 msgr2=0x7f196c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 -- 172.21.15.110:0/1165808718 shutdown_connections 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.039+0000 7f196b200640 1 -- 172.21.15.110:0/1165808718 wait complete. 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.040+0000 7f196b200640 1 Processor -- start 2024-08-17T02:32:20.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.040+0000 7f196b200640 1 -- start start 2024-08-17T02:32:20.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 0x7f196c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c155a30 0x7f196c0a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.043 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c157080 con 0x7f196c155660 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c158e40 con 0x7f196c0adfb0 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.041+0000 7f196b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c158ba0 con 0x7f196c155a30 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50536/0 (socket says 172.21.15.110:50536) 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 -- 172.21.15.110:0/3395475128 learned_addr learned my addr 172.21.15.110:0/3395475128 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1969e00640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 0x7f196c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f196a800640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c155a30 0x7f196c0a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 -- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c155a30 msgr2=0x7f196c0a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c155a30 0x7f196c0a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 -- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 msgr2=0x7f196c149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 0x7f196c149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 -- 172.21.15.110:0/3395475128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1964009a20 con 0x7f196c155660 2024-08-17T02:32:20.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1969e00640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 0x7f196c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1961400640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f195400c810 tx=0x7f1954007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400a640 con 0x7f196c155660 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.042+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400a7c0 con 0x7f196c155660 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.043+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c156a30 con 0x7f196c155660 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.043+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400abc0 con 0x7f196c155660 2024-08-17T02:32:20.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.043+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c0ab3c0 con 0x7f196c155660 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.044+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c071050 con 0x7f196c155660 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.044+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1954012420 con 0x7f196c155660 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.045+0000 7f1962000640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 0x7f1948067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.045+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1954082520 con 0x7f196c155660 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.045+0000 7f1969e00640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 0x7f1948067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.046 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.046+0000 7f1969e00640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 0x7f1948067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f195c0015a0 tx=0x7f195c000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.049 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.049+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19540501c0 con 0x7f196c155660 2024-08-17T02:32:20.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.220+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f196c0c82a0 con 0x7f196c155660 2024-08-17T02:32:20.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.221+0000 7f1962000640 1 -- 172.21.15.110:0/3395475128 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19540537e0 con 0x7f196c155660 2024-08-17T02:32:20.222 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 64 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 msgr2=0x7f1948067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 0x7f1948067630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f195c0015a0 tx=0x7f195c000bc0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 msgr2=0x7f196c0a76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f195400c810 tx=0x7f1954007e60 comp rx=0 tx=0).stop 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 shutdown_connections 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f1948065180 0x7f1948067630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c155a30 0x7f196c0a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f196c155660 0x7f196c0a76e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 --2- 172.21.15.110:0/3395475128 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0adfb0 0x7f196c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.223+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 >> 172.21.15.110:0/3395475128 conn(0x7f196c066cd0 msgr2=0x7f196c0691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.224+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 shutdown_connections 2024-08-17T02:32:20.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.224+0000 7f196b200640 1 -- 172.21.15.110:0/3395475128 wait complete. 2024-08-17T02:32:20.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000013181.meta pg_num 2024-08-17T02:32:20.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.389+0000 7fec85e00640 1 Processor -- start 2024-08-17T02:32:20.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.390+0000 7fec85e00640 1 -- start start 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155660 0x7fec800c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fec800adfb0 0x7fec800ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800afc40 con 0x7fec80155a30 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800af030 con 0x7fec800adfb0 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800af310 con 0x7fec80155660 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fec80155a30 0x7fec8006dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37244/0 (socket says 172.21.15.110:37244) 2024-08-17T02:32:20.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec85400640 1 -- 172.21.15.110:0/1830143307 learned_addr learned my addr 172.21.15.110:0/1830143307 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:20.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec77e00640 1 --2- 172.21.15.110:0/1830143307 >> v2:172.21.15.177:3300/0 conn(0x7fec800adfb0 0x7fec800ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec84a00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155660 0x7fec800c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec7fe00640 1 -- 172.21.15.110:0/1830143307 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3405649885 0 0) 0x7fec800afc40 con 0x7fec80155a30 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.391+0000 7fec7fe00640 1 -- 172.21.15.110:0/1830143307 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec640034e0 con 0x7fec80155a30 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.392+0000 7fec77e00640 1 -- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155660 msgr2=0x7fec800c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.392+0000 7fec77e00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155660 0x7fec800c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.392+0000 7fec77e00640 1 -- 172.21.15.110:0/1830143307 >> v1:172.21.15.110:6789/0 conn(0x7fec80155a30 legacy=0x7fec8006dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.392+0000 7fec77e00640 1 -- 172.21.15.110:0/1830143307 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800af5f0 con 0x7fec800adfb0 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.393+0000 7fec77e00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec800adfb0 0x7fec800ae750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec68009850 tx=0x7fec680090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0a5e41b93b1588c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.393+0000 7fec7fe00640 1 -- 172.21.15.110:0/1830143307 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec68031510 con 0x7fec800adfb0 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.393+0000 7fec7fe00640 1 -- 172.21.15.110:0/1830143307 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6802f050 con 0x7fec800adfb0 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.393+0000 7fec7fe00640 1 -- 172.21.15.110:0/1830143307 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680318e0 con 0x7fec800adfb0 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 -- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec800adfb0 msgr2=0x7fec800ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec800adfb0 0x7fec800ae750 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec68009850 tx=0x7fec680090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 -- 172.21.15.110:0/1830143307 shutdown_connections 2024-08-17T02:32:20.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec800adfb0 0x7fec800ae750 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 --2- 172.21.15.110:0/1830143307 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155660 0x7fec800c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 -- 172.21.15.110:0/1830143307 >> 172.21.15.110:0/1830143307 conn(0x7fec80066cd0 msgr2=0x7fec800670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 -- 172.21.15.110:0/1830143307 shutdown_connections 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.394+0000 7fec85e00640 1 -- 172.21.15.110:0/1830143307 wait complete. 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.395+0000 7fec85e00640 1 Processor -- start 2024-08-17T02:32:20.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.395+0000 7fec85e00640 1 -- start start 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 0x7fec80153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155a30 0x7fec8006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8015c280 con 0x7fec800adfb0 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8016c370 con 0x7fec80155660 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec85e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8016d190 con 0x7fec80155a30 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec84a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec84a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50548/0 (socket says 172.21.15.110:50548) 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec84a00640 1 -- 172.21.15.110:0/2405479765 learned_addr learned my addr 172.21.15.110:0/2405479765 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.396+0000 7fec77e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 0x7fec80153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec85400640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155a30 0x7fec8006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 -- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155a30 msgr2=0x7fec8006dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155a30 0x7fec8006dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 -- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 msgr2=0x7fec80153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 0x7fec80153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 -- 172.21.15.110:0/2405479765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009390 con 0x7fec800adfb0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec77e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 0x7fec80153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec84a00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec7000ea20 tx=0x7fec700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000ca10 con 0x7fec800adfb0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000cb70 con 0x7fec800adfb0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8016c860 con 0x7fec800adfb0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70013470 con 0x7fec800adfb0 2024-08-17T02:32:20.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.397+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8016ce20 con 0x7fec800adfb0 2024-08-17T02:32:20.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.398+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80071050 con 0x7fec800adfb0 2024-08-17T02:32:20.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.399+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fec70013860 con 0x7fec800adfb0 2024-08-17T02:32:20.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.400+0000 7fec7cc00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 0x7fec5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.400+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fec70082c20 con 0x7fec800adfb0 2024-08-17T02:32:20.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.400+0000 7fec77e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 0x7fec5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.401 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.401+0000 7fec77e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 0x7fec5c067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec68036000 tx=0x7fec68037000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.404+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fec700508c0 con 0x7fec800adfb0 2024-08-17T02:32:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.575+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.meta", "var": "pg_num"} v 0) v1 -- 0x7fec800c7dc0 con 0x7fec800adfb0 2024-08-17T02:32:20.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.575+0000 7fec7cc00640 1 -- 172.21.15.110:0/2405479765 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.meta", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7fec700170c0 con 0x7fec800adfb0 2024-08-17T02:32:20.575 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 msgr2=0x7fec5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 0x7fec5c067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec68036000 tx=0x7fec68037000 comp rx=0 tx=0).stop 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 msgr2=0x7fec8015bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fec7000ea20 tx=0x7fec700090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 shutdown_connections 2024-08-17T02:32:20.578 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fec5c065150 0x7fec5c067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fec80155a30 0x7fec8006dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fec80155660 0x7fec80153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 --2- 172.21.15.110:0/2405479765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec800adfb0 0x7fec8015bd40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 >> 172.21.15.110:0/2405479765 conn(0x7fec80066cd0 msgr2=0x7fec80151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 shutdown_connections 2024-08-17T02:32:20.579 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.577+0000 7fec85e00640 1 -- 172.21.15.110:0/2405479765 wait complete. 2024-08-17T02:32:20.593 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000013181.data pg_num 2024-08-17T02:32:20.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.742+0000 7f733ba00640 1 Processor -- start 2024-08-17T02:32:20.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.742+0000 7f733ba00640 1 -- start start 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.743+0000 7f733ba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7334155a80 0x7f733406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.743+0000 7f733ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f73340c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.743+0000 7f733ba00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73341598f0 con 0x7f7334155e50 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.743+0000 7f733ba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7334159bd0 con 0x7f7334155a80 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.743+0000 7f733ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7334159eb0 con 0x7f73340c7db0 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f7339a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7334155e50 0x7f733406c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37248/0 (socket says 172.21.15.110:37248) 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f7339a00640 1 -- 172.21.15.110:0/1930933807 learned_addr learned my addr 172.21.15.110:0/1930933807 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f732be00640 1 --2- 172.21.15.110:0/1930933807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f73340c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f7339000640 1 --2- 172.21.15.110:0/1930933807 >> v2:172.21.15.177:3300/0 conn(0x7f7334155a80 0x7f733406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317751167 0 0) 0x7f73341598f0 con 0x7f7334155e50 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.744+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73180034e0 con 0x7f7334155e50 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.745+0000 7f732be00640 1 -- 172.21.15.110:0/1930933807 >> v2:172.21.15.177:3300/0 conn(0x7f7334155a80 msgr2=0x7f733406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.745+0000 7f732be00640 1 --2- 172.21.15.110:0/1930933807 >> v2:172.21.15.177:3300/0 conn(0x7f7334155a80 0x7f733406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.745+0000 7f732be00640 1 -- 172.21.15.110:0/1930933807 >> v1:172.21.15.110:6789/0 conn(0x7f7334155e50 legacy=0x7f733406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.745+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009352980 0 0) 0x7f73180034e0 con 0x7f7334155e50 2024-08-17T02:32:20.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.745+0000 7f732be00640 1 -- 172.21.15.110:0/1930933807 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733415a190 con 0x7f73340c7db0 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f732be00640 1 --2- 172.21.15.110:0/1930933807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f73340c8bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f731c009850 tx=0x7f731c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f254e3d57d3e0f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c0017f0 con 0x7f73340c7db0 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c02aa50 con 0x7f73340c7db0 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f7333e00640 1 -- 172.21.15.110:0/1930933807 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c02adf0 con 0x7f73340c7db0 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f733ba00640 1 -- 172.21.15.110:0/1930933807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 msgr2=0x7f73340c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.746+0000 7f733ba00640 1 --2- 172.21.15.110:0/1930933807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f73340c8bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f731c009850 tx=0x7f731c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 -- 172.21.15.110:0/1930933807 shutdown_connections 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 --2- 172.21.15.110:0/1930933807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f73340c8bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 --2- 172.21.15.110:0/1930933807 >> v2:172.21.15.177:3300/0 conn(0x7f7334155a80 0x7f733406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 -- 172.21.15.110:0/1930933807 >> 172.21.15.110:0/1930933807 conn(0x7f7334067750 msgr2=0x7f73340c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 -- 172.21.15.110:0/1930933807 shutdown_connections 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.747+0000 7f733ba00640 1 -- 172.21.15.110:0/1930933807 wait complete. 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.748+0000 7f733ba00640 1 Processor -- start 2024-08-17T02:32:20.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.748+0000 7f733ba00640 1 -- start start 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f7334157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 0x7f7334146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733416b680 con 0x7f7334155a80 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73341476e0 con 0x7f7334155e50 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f733ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73341479c0 con 0x7f73340c7db0 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f732be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f732be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50550/0 (socket says 172.21.15.110:50550) 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f732be00640 1 -- 172.21.15.110:0/2284618875 learned_addr learned my addr 172.21.15.110:0/2284618875 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f7339000640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f7334157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.749+0000 7f7339a00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 0x7f7334146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 -- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 msgr2=0x7f7334157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f7334157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 -- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 msgr2=0x7f7334146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 0x7f7334146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 -- 172.21.15.110:0/2284618875 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c009390 con 0x7f7334155a80 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f7339000640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f7334157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f7339a00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 0x7f7334146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f732be00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f731c009850 tx=0x7f731c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c032e60 con 0x7f7334155a80 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c03d420 con 0x7f7334155a80 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c03d7e0 con 0x7f7334155a80 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334147ca0 con 0x7f7334155a80 2024-08-17T02:32:20.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.750+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334147330 con 0x7f7334155a80 2024-08-17T02:32:20.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.751+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334071050 con 0x7f7334155a80 2024-08-17T02:32:20.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.752+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f731c039040 con 0x7f7334155a80 2024-08-17T02:32:20.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.753+0000 7f7330c00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 0x7f7310067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:20.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.753+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f731c0a1de0 con 0x7f7334155a80 2024-08-17T02:32:20.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.753+0000 7f7339000640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 0x7f7310067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:20.754 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.754+0000 7f7339000640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 0x7f7310067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7324006e70 tx=0x7f7324008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:20.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.757+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f731c06fa80 con 0x7f7334155a80 2024-08-17T02:32:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.929+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.data", "var": "pg_num"} v 0) v1 -- 0x7f733406aa10 con 0x7f7334155a80 2024-08-17T02:32:20.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.929+0000 7f7330c00640 1 -- 172.21.15.110:0/2284618875 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.data", "var": "pg_num"}]=0 v38) v1 ==== 124+0+11 (secure 0 0 0) 0x7f731c0370c0 con 0x7f7334155a80 2024-08-17T02:32:20.930 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:32:20.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 msgr2=0x7f7310067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 0x7f7310067600 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7324006e70 tx=0x7f7324008040 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 msgr2=0x7f733416b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f731c009850 tx=0x7f731c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 shutdown_connections 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7310065150 0x7f7310067600 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7334155e50 0x7f7334146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7334155a80 0x7f733416b140 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 --2- 172.21.15.110:0/2284618875 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73340c7db0 0x7f7334157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 >> 172.21.15.110:0/2284618875 conn(0x7f7334067750 msgr2=0x7f73340adbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 shutdown_connections 2024-08-17T02:32:20.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:20.931+0000 7f733ba00640 1 -- 172.21.15.110:0/2284618875 wait complete. 2024-08-17T02:32:20.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.096+0000 7ff04bc00640 1 Processor -- start 2024-08-17T02:32:21.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.096+0000 7ff04bc00640 1 -- start start 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff04bc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff044155550 0x7ff0440aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff04bc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440afc10 con 0x7ff044155180 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff04bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0440af000 con 0x7ff04406e080 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff04bc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0440af2e0 con 0x7ff044155550 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff049200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff044155180 0x7ff0440ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37254/0 (socket says 172.21.15.110:37254) 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff049200640 1 -- 172.21.15.110:0/3015347793 learned_addr learned my addr 172.21.15.110:0/3015347793 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:21.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.097+0000 7ff043e00640 1 --2- 172.21.15.110:0/3015347793 >> v2:172.21.15.110:3300/0 conn(0x7ff044155550 0x7ff0440aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.098+0000 7ff043400640 1 -- 172.21.15.110:0/3015347793 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611478037 0 0) 0x7ff0440afc10 con 0x7ff044155180 2024-08-17T02:32:21.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.098+0000 7ff043e00640 1 -- 172.21.15.110:0/3015347793 >> v1:172.21.15.177:6789/0 conn(0x7ff04406e080 legacy=0x7ff04406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.098+0000 7ff043e00640 1 -- 172.21.15.110:0/3015347793 >> v1:172.21.15.110:6789/0 conn(0x7ff044155180 legacy=0x7ff0440ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.098+0000 7ff043e00640 1 -- 172.21.15.110:0/3015347793 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440af5c0 con 0x7ff044155550 2024-08-17T02:32:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.099+0000 7ff043e00640 1 --2- 172.21.15.110:0/3015347793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff044155550 0x7ff0440aea20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff030009850 tx=0x7ff0300090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c8d2cc1a04ee6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.099+0000 7ff043400640 1 -- 172.21.15.110:0/3015347793 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03002ae20 con 0x7ff044155550 2024-08-17T02:32:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.099+0000 7ff043400640 1 -- 172.21.15.110:0/3015347793 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff030032440 con 0x7ff044155550 2024-08-17T02:32:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.099+0000 7ff043400640 1 -- 172.21.15.110:0/3015347793 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300327e0 con 0x7ff044155550 2024-08-17T02:32:21.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 -- 172.21.15.110:0/3015347793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff044155550 msgr2=0x7ff0440aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 --2- 172.21.15.110:0/3015347793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff044155550 0x7ff0440aea20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff030009850 tx=0x7ff0300090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 -- 172.21.15.110:0/3015347793 shutdown_connections 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 --2- 172.21.15.110:0/3015347793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff044155550 0x7ff0440aea20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 -- 172.21.15.110:0/3015347793 >> 172.21.15.110:0/3015347793 conn(0x7ff0440cb9b0 msgr2=0x7ff0440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 -- 172.21.15.110:0/3015347793 shutdown_connections 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.100+0000 7ff04bc00640 1 -- 172.21.15.110:0/3015347793 wait complete. 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.101+0000 7ff04bc00640 1 Processor -- start 2024-08-17T02:32:21.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.101+0000 7ff04bc00640 1 -- start start 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff044155180 0x7ff04414f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff044155550 0x7ff04414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff044167e20 con 0x7ff04406e080 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04414faf0 con 0x7ff044155550 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff04bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff044167a10 con 0x7ff044155180 2024-08-17T02:32:21.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff049200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff049200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50576/0 (socket says 172.21.15.110:50576) 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.102+0000 7ff049200640 1 -- 172.21.15.110:0/2370379869 learned_addr learned my addr 172.21.15.110:0/2370379869 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff043e00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff044155180 0x7ff04414f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049c00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff044155550 0x7ff04414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 -- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff044155180 msgr2=0x7ff04414f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff044155180 0x7ff04414f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 -- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff044155550 msgr2=0x7ff04414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff044155550 0x7ff04414f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 -- 172.21.15.110:0/2370379869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009390 con 0x7ff04406e080 2024-08-17T02:32:21.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff049200640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c5e0 tx=0x7ff038007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038005aa0 con 0x7ff04406e080 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038005c20 con 0x7ff04406e080 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380070f0 con 0x7ff04406e080 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff044168000 con 0x7ff04406e080 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.103+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff044150b20 con 0x7ff04406e080 2024-08-17T02:32:21.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.104+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff044150d70 con 0x7ff04406e080 2024-08-17T02:32:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.105+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff038007520 con 0x7ff04406e080 2024-08-17T02:32:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.106+0000 7ff037e00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 0x7ff024067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.106+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7ff038082260 con 0x7ff04406e080 2024-08-17T02:32:21.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.106+0000 7ff043e00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 0x7ff024067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.107+0000 7ff043e00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 0x7ff024067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff030032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.110+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff03804ff80 con 0x7ff04406e080 2024-08-17T02:32:21.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.320+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff044064db0 con 0x7ff04406e080 2024-08-17T02:32:21.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.321+0000 7ff037e00640 1 -- 172.21.15.110:0/2370379869 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5696 (secure 0 0 0) 0x7ff0380535a0 con 0x7ff04406e080 2024-08-17T02:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:21.321 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:21.321 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 21 2024-08-17T02:32:21.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 msgr2=0x7ff024067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 0x7ff024067600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff030034000 tx=0x7ff030032000 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 msgr2=0x7ff0441505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c5e0 tx=0x7ff038007d00 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 shutdown_connections 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff024065150 0x7ff024067600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff044155550 0x7ff04414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff044155180 0x7ff04414f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 --2- 172.21.15.110:0/2370379869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff04406e080 0x7ff0441505e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 >> 172.21.15.110:0/2370379869 conn(0x7ff0440cb9b0 msgr2=0x7ff0440acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 shutdown_connections 2024-08-17T02:32:21.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.323+0000 7ff04bc00640 1 -- 172.21.15.110:0/2370379869 wait complete. 2024-08-17T02:32:21.338 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.485+0000 7fd230c00640 1 Processor -- start 2024-08-17T02:32:21.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.485+0000 7fd230c00640 1 -- start start 2024-08-17T02:32:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd230c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd22c1401b0 0x7fd22c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd230c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 0x7fd22c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd230c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c0b16d0 con 0x7fd22c0b1270 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd230c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0cb450 con 0x7fd22c1401b0 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd230c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0caa80 con 0x7fd22c140580 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd22a800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd22c0b1270 0x7fd22c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37266/0 (socket says 172.21.15.110:37266) 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd22a800640 1 -- 172.21.15.110:0/2565613706 learned_addr learned my addr 172.21.15.110:0/2565613706 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd229400640 1 --2- 172.21.15.110:0/2565613706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 0x7fd22c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.487+0000 7fd229e00640 1 --2- 172.21.15.110:0/2565613706 >> v2:172.21.15.177:3300/0 conn(0x7fd22c1401b0 0x7fd22c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.488+0000 7fd229400640 1 -- 172.21.15.110:0/2565613706 >> v2:172.21.15.177:3300/0 conn(0x7fd22c1401b0 msgr2=0x7fd22c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:21.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.488+0000 7fd229400640 1 --2- 172.21.15.110:0/2565613706 >> v2:172.21.15.177:3300/0 conn(0x7fd22c1401b0 0x7fd22c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.488+0000 7fd229400640 1 -- 172.21.15.110:0/2565613706 >> v1:172.21.15.110:6789/0 conn(0x7fd22c0b1270 legacy=0x7fd22c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.488+0000 7fd229400640 1 -- 172.21.15.110:0/2565613706 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0c9e70 con 0x7fd22c140580 2024-08-17T02:32:21.489 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.489+0000 7fd229400640 1 --2- 172.21.15.110:0/2565613706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 0x7fd22c0b0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd218009850 tx=0x7fd2180090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44d0bda6b58b0bc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.489+0000 7fd228a00640 1 -- 172.21.15.110:0/2565613706 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21802ad00 con 0x7fd22c140580 2024-08-17T02:32:21.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.489+0000 7fd228a00640 1 -- 172.21.15.110:0/2565613706 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21802ae60 con 0x7fd22c140580 2024-08-17T02:32:21.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.489+0000 7fd228a00640 1 -- 172.21.15.110:0/2565613706 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218032670 con 0x7fd22c140580 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 -- 172.21.15.110:0/2565613706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 msgr2=0x7fd22c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 --2- 172.21.15.110:0/2565613706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 0x7fd22c0b0d30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd218009850 tx=0x7fd2180090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 -- 172.21.15.110:0/2565613706 shutdown_connections 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 --2- 172.21.15.110:0/2565613706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c140580 0x7fd22c0b0d30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 --2- 172.21.15.110:0/2565613706 >> v2:172.21.15.177:3300/0 conn(0x7fd22c1401b0 0x7fd22c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 -- 172.21.15.110:0/2565613706 >> 172.21.15.110:0/2565613706 conn(0x7fd22c0cb9b0 msgr2=0x7fd22c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 -- 172.21.15.110:0/2565613706 shutdown_connections 2024-08-17T02:32:21.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.490+0000 7fd230c00640 1 -- 172.21.15.110:0/2565613706 wait complete. 2024-08-17T02:32:21.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.491+0000 7fd230c00640 1 Processor -- start 2024-08-17T02:32:21.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 -- start start 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c0b1270 0x7fd22c0ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd22c140580 0x7fd22c0c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c159220 con 0x7fd22c1401b0 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0aa4d0 con 0x7fd22c140580 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.492+0000 7fd230c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0aa7b0 con 0x7fd22c0b1270 2024-08-17T02:32:21.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50586/0 (socket says 172.21.15.110:50586) 2024-08-17T02:32:21.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 -- 172.21.15.110:0/903894690 learned_addr learned my addr 172.21.15.110:0/903894690 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:21.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229e00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c0b1270 0x7fd22c0ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd22a800640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd22c140580 0x7fd22c0c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 -- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c0b1270 msgr2=0x7fd22c0ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c0b1270 0x7fd22c0ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 -- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd22c140580 msgr2=0x7fd22c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd22c140580 0x7fd22c0c4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 -- 172.21.15.110:0/903894690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218009390 con 0x7fd22c1401b0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.493+0000 7fd229400640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd218009360 tx=0x7fd218032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.494+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218031700 con 0x7fd22c1401b0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.494+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd218031860 con 0x7fd22c1401b0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.494+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c0aaa90 con 0x7fd22c1401b0 2024-08-17T02:32:21.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.494+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218031c00 con 0x7fd22c1401b0 2024-08-17T02:32:21.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.494+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c0ab050 con 0x7fd22c1401b0 2024-08-17T02:32:21.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.495+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c0ab240 con 0x7fd22c1401b0 2024-08-17T02:32:21.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.496+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd218039040 con 0x7fd22c1401b0 2024-08-17T02:32:21.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.496+0000 7fd221600640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 0x7fd20c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.497+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fd2180a2a60 con 0x7fd22c1401b0 2024-08-17T02:32:21.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.497+0000 7fd229e00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 0x7fd20c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.497 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.497+0000 7fd229e00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 0x7fd20c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd22c16a160 tx=0x7fd21c0090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.501 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.501+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd218070910 con 0x7fd22c1401b0 2024-08-17T02:32:21.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.673+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd22c064db0 con 0x7fd22c1401b0 2024-08-17T02:32:21.674 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.674+0000 7fd221600640 1 -- 172.21.15.110:0/903894690 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7fd218073f30 con 0x7fd22c1401b0 2024-08-17T02:32:21.674 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:21.675 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:30:18.807133+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:21.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 msgr2=0x7fd20c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 0x7fd20c067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd22c16a160 tx=0x7fd21c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 msgr2=0x7fd22c0b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd218009360 tx=0x7fd218032000 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 shutdown_connections 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd20c065150 0x7fd20c067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd22c140580 0x7fd22c0c4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c1401b0 0x7fd22c0b0460 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 --2- 172.21.15.110:0/903894690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd22c0b1270 0x7fd22c0ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 >> 172.21.15.110:0/903894690 conn(0x7fd22c0cb9b0 msgr2=0x7fd22c13ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 shutdown_connections 2024-08-17T02:32:21.677 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.676+0000 7fd230c00640 1 -- 172.21.15.110:0/903894690 wait complete. 2024-08-17T02:32:21.691 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:32:21.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:21.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.840+0000 7f3cf7e00640 1 Processor -- start 2024-08-17T02:32:21.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.840+0000 7f3cf7e00640 1 -- start start 2024-08-17T02:32:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.841+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.841+0000 7f3cf7e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 0x7f3cf80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.841+0000 7f3cf7e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80cc890 con 0x7f3cf80ce6d0 2024-08-17T02:32:21.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.841+0000 7f3cf7e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80ceb20 con 0x7f3cf80c5c40 2024-08-17T02:32:21.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.841+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80cb4c0 con 0x7f3cf80aed50 2024-08-17T02:32:21.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf7400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 0x7f3cf80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:37574/0 (socket says 172.21.15.110:37574) 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2979551196 learned_addr learned my addr 172.21.15.110:0/2979551196 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cefe00640 1 --1- 172.21.15.110:0/2979551196 >> v1:172.21.15.177:6789/0 conn(0x7f3cf80ce6d0 0x7f3cf80ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:60800/0 (socket says 172.21.15.110:60800) 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2979551196 >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 msgr2=0x7f3cf80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 --2- 172.21.15.110:0/2979551196 >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 0x7f3cf80caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2979551196 >> v1:172.21.15.177:6789/0 conn(0x7f3cf80ce6d0 legacy=0x7f3cf80ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2979551196 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80cb7a0 con 0x7f3cf80aed50 2024-08-17T02:32:21.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.842+0000 7f3cf7400640 1 --2- 172.21.15.110:0/2979551196 >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 0x7f3cf80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:21.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.843+0000 7f3cf6a00640 1 --2- 172.21.15.110:0/2979551196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009910 tx=0x7f3ce80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb658e8d2354c6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.843+0000 7f3cf6000640 1 -- 172.21.15.110:0/2979551196 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce802ae40 con 0x7f3cf80aed50 2024-08-17T02:32:21.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf6000640 1 -- 172.21.15.110:0/2979551196 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8032440 con 0x7f3cf80aed50 2024-08-17T02:32:21.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf6000640 1 -- 172.21.15.110:0/2979551196 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8032820 con 0x7f3cf80aed50 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2979551196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 msgr2=0x7f3cf80ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2979551196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009910 tx=0x7f3ce80091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2979551196 shutdown_connections 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2979551196 >> v2:172.21.15.177:3300/0 conn(0x7f3cf80c5c40 0x7f3cf80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2979551196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80aed50 0x7f3cf80ce190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2979551196 >> 172.21.15.110:0/2979551196 conn(0x7f3cf8098e30 msgr2=0x7f3cf806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2979551196 shutdown_connections 2024-08-17T02:32:21.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.844+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2979551196 wait complete. 2024-08-17T02:32:21.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.846+0000 7f3cf7e00640 1 Processor -- start 2024-08-17T02:32:21.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.846+0000 7f3cf7e00640 1 -- start start 2024-08-17T02:32:21.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80c5c40 0x7f3cf80c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cf80ce6d0 0x7f3cf81567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c9510 con 0x7f3cf80aed50 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8156ce0 con 0x7f3cf80ce6d0 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80b1a90 con 0x7f3cf80c5c40 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50596/0 (socket says 172.21.15.110:50596) 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2444948911 learned_addr learned my addr 172.21.15.110:0/2444948911 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf7400640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cf80ce6d0 0x7f3cf81567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cefe00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80c5c40 0x7f3cf80c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80c5c40 msgr2=0x7f3cf80c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80c5c40 0x7f3cf80c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cf80ce6d0 msgr2=0x7f3cf81567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cf80ce6d0 0x7f3cf81567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.847+0000 7f3cf6a00640 1 -- 172.21.15.110:0/2444948911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf0009a20 con 0x7f3cf80aed50 2024-08-17T02:32:21.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cf6a00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009970 tx=0x7f3ce8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8031c80 con 0x7f3cf80aed50 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8031e00 con 0x7f3cf80aed50 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce8009450 con 0x7f3cf80aed50 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce803d670 con 0x7f3cf80aed50 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.848+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80b1160 con 0x7f3cf80aed50 2024-08-17T02:32:21.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.849+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf8071050 con 0x7f3cf80aed50 2024-08-17T02:32:21.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.851+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3ce8039040 con 0x7f3cf80aed50 2024-08-17T02:32:21.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.851+0000 7f3cee000640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 0x7f3cd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:21.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.851+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f3ce802ae40 con 0x7f3cf80aed50 2024-08-17T02:32:21.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.852+0000 7f3cefe00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 0x7f3cd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:21.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.852+0000 7f3cefe00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 0x7f3cd4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80b2100 tx=0x7f3ce0007e20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:21.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:21.855+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3ce8070720 con 0x7f3cf80aed50 2024-08-17T02:32:22.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.065+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cf80b37d0 con 0x7f3cf80aed50 2024-08-17T02:32:22.066 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.066+0000 7f3cee000640 1 -- 172.21.15.110:0/2444948911 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5696 (secure 0 0 0) 0x7f3ce8073d40 con 0x7f3cf80aed50 2024-08-17T02:32:22.066 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:22.067 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:22.067 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 21 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 msgr2=0x7f3cd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 0x7f3cd4067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3cf80b2100 tx=0x7f3ce0007e20 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 msgr2=0x7f3cf80b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009970 tx=0x7f3ce8032000 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 shutdown_connections 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3cd4065150 0x7f3cd4067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cf80ce6d0 0x7f3cf81567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cf80c5c40 0x7f3cf80c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 --2- 172.21.15.110:0/2444948911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cf80aed50 0x7f3cf80b08a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.069 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.068+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 >> 172.21.15.110:0/2444948911 conn(0x7f3cf8098e30 msgr2=0x7f3cf80ca770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.069+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 shutdown_connections 2024-08-17T02:32:22.070 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.069+0000 7f3cf7e00640 1 -- 172.21.15.110:0/2444948911 wait complete. 2024-08-17T02:32:22.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:22.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.231+0000 7f237e600640 1 Processor -- start 2024-08-17T02:32:22.231 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.231+0000 7f237e600640 1 -- start start 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237e600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237e600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2378158ea0 0x7f23780ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237e600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2378067d60 con 0x7f23780af410 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237e600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2378068600 con 0x7f2378158ea0 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237e600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780aff70 con 0x7f2378158ad0 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f2377e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2378158ea0 0x7f23780ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237dc00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f23780af410 0x7f23780af860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37282/0 (socket says 172.21.15.110:37282) 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f237dc00640 1 -- 172.21.15.110:0/2397572277 learned_addr learned my addr 172.21.15.110:0/2397572277 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:22.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.232+0000 7f2377e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2378158ea0 0x7f23780ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50600/0 (socket says 172.21.15.110:50600) 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.233+0000 7f237d200640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.233+0000 7f2377e00640 1 -- 172.21.15.110:0/2397572277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 msgr2=0x7f23780ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.233+0000 7f2377e00640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.233+0000 7f2377e00640 1 -- 172.21.15.110:0/2397572277 >> v1:172.21.15.110:6789/0 conn(0x7f23780af410 legacy=0x7f23780af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.233+0000 7f2377e00640 1 -- 172.21.15.110:0/2397572277 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780b01d0 con 0x7f2378158ea0 2024-08-17T02:32:22.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.234+0000 7f2377e00640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2378158ea0 0x7f23780ac5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2364009850 tx=0x7f23640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cbb4099204398a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.234+0000 7f2377400640 1 -- 172.21.15.110:0/2397572277 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236402ac70 con 0x7f2378158ea0 2024-08-17T02:32:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.234+0000 7f2377400640 1 -- 172.21.15.110:0/2397572277 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236402add0 con 0x7f2378158ea0 2024-08-17T02:32:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.234+0000 7f2377400640 1 -- 172.21.15.110:0/2397572277 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364032670 con 0x7f2378158ea0 2024-08-17T02:32:22.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 -- 172.21.15.110:0/2397572277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2378158ea0 msgr2=0x7f23780ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2378158ea0 0x7f23780ac5b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2364009850 tx=0x7f23640090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 -- 172.21.15.110:0/2397572277 shutdown_connections 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2378158ea0 0x7f23780ac5b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 --2- 172.21.15.110:0/2397572277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 -- 172.21.15.110:0/2397572277 >> 172.21.15.110:0/2397572277 conn(0x7f2378096a70 msgr2=0x7f2378096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 -- 172.21.15.110:0/2397572277 shutdown_connections 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.235+0000 7f237e600640 1 -- 172.21.15.110:0/2397572277 wait complete. 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.236+0000 7f237e600640 1 Processor -- start 2024-08-17T02:32:22.236 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.236+0000 7f237e600640 1 -- start start 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2378158ea0 0x7f2378153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c7070 con 0x7f23780af410 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c72a0 con 0x7f2378158ea0 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237e600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c7580 con 0x7f2378158ad0 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50612/0 (socket says 172.21.15.110:50612) 2024-08-17T02:32:22.239 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f237d200640 1 -- 172.21.15.110:0/1629466140 learned_addr learned my addr 172.21.15.110:0/1629466140 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.237+0000 7f2377e00640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237dc00640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2378158ea0 0x7f2378153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 -- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 msgr2=0x7f23780c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 -- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2378158ea0 msgr2=0x7f2378153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2378158ea0 0x7f2378153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 -- 172.21.15.110:0/1629466140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364009390 con 0x7f23780af410 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237d200640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d890 tx=0x7f236c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00de20 con 0x7f23780af410 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c0098b0 con 0x7f23780af410 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c009c50 con 0x7f23780af410 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23780c7860 con 0x7f23780af410 2024-08-17T02:32:22.240 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.238+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23781538c0 con 0x7f23780af410 2024-08-17T02:32:22.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.240+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2378071050 con 0x7f23780af410 2024-08-17T02:32:22.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.240+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f236c014620 con 0x7f23780af410 2024-08-17T02:32:22.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.241+0000 7f236be00640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 0x7f2358067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.241+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f236c082f70 con 0x7f23780af410 2024-08-17T02:32:22.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.241+0000 7f2377e00640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 0x7f2358067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.242 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.242+0000 7f2377e00640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 0x7f2358067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2364034000 tx=0x7f2364032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.245+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f236c0b4e40 con 0x7f23780af410 2024-08-17T02:32:22.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.451+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f237806aaf0 con 0x7f23780af410 2024-08-17T02:32:22.452 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.452+0000 7f236be00640 1 -- 172.21.15.110:0/1629466140 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5696 (secure 0 0 0) 0x7f236c050cb0 con 0x7f23780af410 2024-08-17T02:32:22.452 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:22.453 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:29:58.116053+0000","modified":"2024-08-17T02:30:01.735236+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4920},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4920":{"gid":4920,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/3374805694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3374805694},{"type":"v1","addr":"172.21.15.110:6835","nonce":3374805694}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:22.453 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 21 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 msgr2=0x7f2358067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 0x7f2358067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2364034000 tx=0x7f2364032000 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 msgr2=0x7f23780b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d890 tx=0x7f236c008040 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 shutdown_connections 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2358065150 0x7f2358067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2378158ea0 0x7f2378153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2378158ad0 0x7f23780c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 --2- 172.21.15.110:0/1629466140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23780af410 0x7f23780b2770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 >> 172.21.15.110:0/1629466140 conn(0x7f2378096a70 msgr2=0x7f23780ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 shutdown_connections 2024-08-17T02:32:22.455 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.454+0000 7f237e600640 1 -- 172.21.15.110:0/1629466140 wait complete. 2024-08-17T02:32:22.469 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:22.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.616+0000 7f712a000640 1 Processor -- start 2024-08-17T02:32:22.617 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.616+0000 7f712a000640 1 -- start start 2024-08-17T02:32:22.618 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.617+0000 7f712a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 0x7f71240adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.617+0000 7f712a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7124155df0 0x7f71240ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.617+0000 7f712a000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7124156670 con 0x7f7124155a20 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.617+0000 7f712a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71240b0350 con 0x7f7124155df0 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.617+0000 7f712a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712406e5e0 con 0x7f712406df00 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f7123400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7124155a20 0x7f712406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37286/0 (socket says 172.21.15.110:37286) 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f7123400640 1 -- 172.21.15.110:0/2650981034 learned_addr learned my addr 172.21.15.110:0/2650981034 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f711aa00640 1 --2- 172.21.15.110:0/2650981034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 0x7f71240adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f7123e00640 1 --2- 172.21.15.110:0/2650981034 >> v2:172.21.15.177:3300/0 conn(0x7f7124155df0 0x7f71240ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f7122a00640 1 -- 172.21.15.110:0/2650981034 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647952281 0 0) 0x7f7124156670 con 0x7f7124155a20 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f7122a00640 1 -- 172.21.15.110:0/2650981034 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71080034e0 con 0x7f7124155a20 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f711aa00640 1 -- 172.21.15.110:0/2650981034 >> v2:172.21.15.177:3300/0 conn(0x7f7124155df0 msgr2=0x7f71240ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f711aa00640 1 --2- 172.21.15.110:0/2650981034 >> v2:172.21.15.177:3300/0 conn(0x7f7124155df0 0x7f71240ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f711aa00640 1 -- 172.21.15.110:0/2650981034 >> v1:172.21.15.110:6789/0 conn(0x7f7124155a20 legacy=0x7f712406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.620 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.618+0000 7f711aa00640 1 -- 172.21.15.110:0/2650981034 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712406e8c0 con 0x7f712406df00 2024-08-17T02:32:22.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f711aa00640 1 --2- 172.21.15.110:0/2650981034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 0x7f71240adf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f710c009850 tx=0x7f710c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd5a82acad420da server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f7122a00640 1 -- 172.21.15.110:0/2650981034 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c02ad90 con 0x7f712406df00 2024-08-17T02:32:22.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f7122a00640 1 -- 172.21.15.110:0/2650981034 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c032440 con 0x7f712406df00 2024-08-17T02:32:22.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f7122a00640 1 -- 172.21.15.110:0/2650981034 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c0327e0 con 0x7f712406df00 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f712a000640 1 -- 172.21.15.110:0/2650981034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 msgr2=0x7f71240adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.620+0000 7f712a000640 1 --2- 172.21.15.110:0/2650981034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 0x7f71240adf10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f710c009850 tx=0x7f710c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 -- 172.21.15.110:0/2650981034 shutdown_connections 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 --2- 172.21.15.110:0/2650981034 >> v2:172.21.15.177:3300/0 conn(0x7f7124155df0 0x7f71240ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 --2- 172.21.15.110:0/2650981034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f712406df00 0x7f71240adf10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 -- 172.21.15.110:0/2650981034 >> 172.21.15.110:0/2650981034 conn(0x7f71240cb9b0 msgr2=0x7f71240cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 -- 172.21.15.110:0/2650981034 shutdown_connections 2024-08-17T02:32:22.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.621+0000 7f712a000640 1 -- 172.21.15.110:0/2650981034 wait complete. 2024-08-17T02:32:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.622+0000 7f712a000640 1 Processor -- start 2024-08-17T02:32:22.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.622+0000 7f712a000640 1 -- start start 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7124155a20 0x7f71241457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7124155df0 0x7f71241427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7124146bc0 con 0x7f712406df00 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7124145d30 con 0x7f7124155a20 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f712a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7124142d20 con 0x7f7124155df0 2024-08-17T02:32:22.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f7123400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f7123400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50626/0 (socket says 172.21.15.110:50626) 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.623+0000 7f7123400640 1 -- 172.21.15.110:0/36150303 learned_addr learned my addr 172.21.15.110:0/36150303 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123e00640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7124155df0 0x7f71241427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f711aa00640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7124155a20 0x7f71241457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 -- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7124155df0 msgr2=0x7f71241427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7124155df0 0x7f71241427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 -- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7124155a20 msgr2=0x7f71241457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7124155a20 0x7f71241457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 -- 172.21.15.110:0/36150303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c009390 con 0x7f712406df00 2024-08-17T02:32:22.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f7123400640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f711400c5b0 tx=0x7f7114007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114005b70 con 0x7f712406df00 2024-08-17T02:32:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114005cf0 con 0x7f712406df00 2024-08-17T02:32:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007340 con 0x7f712406df00 2024-08-17T02:32:22.626 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7124145fb0 con 0x7f712406df00 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.624+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7124146570 con 0x7f712406df00 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.625+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7124064db0 con 0x7f712406df00 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.626+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f711401b400 con 0x7f712406df00 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.627+0000 7f711b400640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 0x7f7100067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.627+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f7114082410 con 0x7f712406df00 2024-08-17T02:32:22.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.627+0000 7f711aa00640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 0x7f7100067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.628+0000 7f711aa00640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 0x7f7100067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f710c009850 tx=0x7f710c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.631+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7114050130 con 0x7f712406df00 2024-08-17T02:32:22.809 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.809+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71240af130 con 0x7f712406df00 2024-08-17T02:32:22.810 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.810+0000 7f711b400640 1 -- 172.21.15.110:0/36150303 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18647 (secure 0 0 0) 0x7f7114053750 con 0x7f712406df00 2024-08-17T02:32:22.811 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:22.811 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":38,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:30:18.807133+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:29:56.090122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:29:57.105839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 msgr2=0x7f7100067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 0x7f7100067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f710c009850 tx=0x7f710c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 msgr2=0x7f7124143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f711400c5b0 tx=0x7f7114007d70 comp rx=0 tx=0).stop 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 shutdown_connections 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7100065150 0x7f7100067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.813 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7124155df0 0x7f71241427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7124155a20 0x7f71241457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 --2- 172.21.15.110:0/36150303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712406df00 0x7f7124143eb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 >> 172.21.15.110:0/36150303 conn(0x7f71240cb9b0 msgr2=0x7f712406d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.812+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 shutdown_connections 2024-08-17T02:32:22.814 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.813+0000 7f712a000640 1 -- 172.21.15.110:0/36150303 wait complete. 2024-08-17T02:32:22.828 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:32:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.975+0000 7fca4b000640 1 Processor -- start 2024-08-17T02:32:22.975 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.975+0000 7fca4b000640 1 -- start start 2024-08-17T02:32:22.976 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca4b000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fca44140580 0x7fca440c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca4b000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440caa80 con 0x7fca441401b0 2024-08-17T02:32:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca4b000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440c9e70 con 0x7fca440b1440 2024-08-17T02:32:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca4b000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca440c9c90 con 0x7fca44140580 2024-08-17T02:32:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca43e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fca441401b0 0x7fca440b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37290/0 (socket says 172.21.15.110:37290) 2024-08-17T02:32:22.977 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.976+0000 7fca43e00640 1 -- 172.21.15.110:0/2601689924 learned_addr learned my addr 172.21.15.110:0/2601689924 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca49000640 1 --2- 172.21.15.110:0/2601689924 >> v2:172.21.15.110:3300/0 conn(0x7fca44140580 0x7fca440c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288408626 0 0) 0x7fca440caa80 con 0x7fca441401b0 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca280034e0 con 0x7fca441401b0 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77224385 0 0) 0x7fca440c9e70 con 0x7fca440b1440 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca440caa80 con 0x7fca440b1440 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca49000640 1 -- 172.21.15.110:0/2601689924 >> v1:172.21.15.177:6789/0 conn(0x7fca440b1440 legacy=0x7fca440c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca49000640 1 -- 172.21.15.110:0/2601689924 >> v1:172.21.15.110:6789/0 conn(0x7fca441401b0 legacy=0x7fca440b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.978 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.977+0000 7fca49000640 1 -- 172.21.15.110:0/2601689924 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440ca150 con 0x7fca44140580 2024-08-17T02:32:22.979 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.978+0000 7fca49000640 1 --2- 172.21.15.110:0/2601689924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca44140580 0x7fca440c9750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009e60 tx=0x7fca3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba679837e4d97495 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.978+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c007550 con 0x7fca44140580 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.978+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c02d050 con 0x7fca44140580 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.978+0000 7fca42a00640 1 -- 172.21.15.110:0/2601689924 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c007900 con 0x7fca44140580 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 -- 172.21.15.110:0/2601689924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca44140580 msgr2=0x7fca440c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 --2- 172.21.15.110:0/2601689924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca44140580 0x7fca440c9750 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009e60 tx=0x7fca3c009780 comp rx=0 tx=0).stop 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 -- 172.21.15.110:0/2601689924 shutdown_connections 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 --2- 172.21.15.110:0/2601689924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca44140580 0x7fca440c9750 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 -- 172.21.15.110:0/2601689924 >> 172.21.15.110:0/2601689924 conn(0x7fca440cb9b0 msgr2=0x7fca440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 -- 172.21.15.110:0/2601689924 shutdown_connections 2024-08-17T02:32:22.980 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.979+0000 7fca4b000640 1 -- 172.21.15.110:0/2601689924 wait complete. 2024-08-17T02:32:22.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.980+0000 7fca4b000640 1 Processor -- start 2024-08-17T02:32:22.981 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 -- start start 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca441401b0 0x7fca440acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca44140580 0x7fca4413ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44168a10 con 0x7fca440b1440 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca44169c40 con 0x7fca44140580 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.981+0000 7fca4b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4416cd40 con 0x7fca441401b0 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.983 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50642/0 (socket says 172.21.15.110:50642) 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 -- 172.21.15.110:0/4265663287 learned_addr learned my addr 172.21.15.110:0/4265663287 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 -- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca441401b0 msgr2=0x7fca440acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca441401b0 0x7fca440acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 -- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca44140580 msgr2=0x7fca4413ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca44140580 0x7fca4413ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 -- 172.21.15.110:0/4265663287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009a20 con 0x7fca440b1440 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca43e00640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fca34005840 tx=0x7fca34007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.982+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34005aa0 con 0x7fca440b1440 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.983+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34005c00 con 0x7fca440b1440 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.983+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340070f0 con 0x7fca440b1440 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.983+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca44168c20 con 0x7fca440b1440 2024-08-17T02:32:22.984 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.983+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca441691e0 con 0x7fca440b1440 2024-08-17T02:32:22.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.984+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca44064db0 con 0x7fca440b1440 2024-08-17T02:32:22.985 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.985+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fca34007520 con 0x7fca440b1440 2024-08-17T02:32:22.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.985+0000 7fca3b400640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 0x7fca24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:22.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.986+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fca34082310 con 0x7fca440b1440 2024-08-17T02:32:22.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.986+0000 7fca43400640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 0x7fca24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:22.986 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.986+0000 7fca43400640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 0x7fca24067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca30002650 tx=0x7fca30007940 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:22.989 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:22.989+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fca34050030 con 0x7fca440b1440 2024-08-17T02:32:23.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.196+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fca441693d0 con 0x7fca440b1440 2024-08-17T02:32:23.197 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-08-17T02:32:23.197+0000 7f9668200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:32:23.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.201+0000 7fca3b400640 1 -- 172.21.15.110:0/4265663287 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fca34053650 con 0x7fca440b1440 2024-08-17T02:32:23.201 INFO:teuthology.orchestra.run.smithi110.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 msgr2=0x7fca24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 0x7fca24067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fca30002650 tx=0x7fca30007940 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 msgr2=0x7fca44169700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fca34005840 tx=0x7fca34007e10 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 shutdown_connections 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fca24065150 0x7fca24067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca44140580 0x7fca4413ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca441401b0 0x7fca440acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 --2- 172.21.15.110:0/4265663287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca440b1440 0x7fca44169700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.203+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 >> 172.21.15.110:0/4265663287 conn(0x7fca440cb9b0 msgr2=0x7fca4406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:23.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.204+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 shutdown_connections 2024-08-17T02:32:23.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.204+0000 7fca4b000640 1 -- 172.21.15.110:0/4265663287 wait complete. 2024-08-17T02:32:23.213 INFO:tasks.ceph.mds.a.smithi110.stderr: -7367> 2024-08-17T02:30:01.678+0000 7f8bc4e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:32:23.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:32:23.259 INFO:tasks.ceph.mds.a.smithi110.stdout:starting mds.a at 2024-08-17T02:32:23.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.373+0000 7fbfdb000640 1 Processor -- start 2024-08-17T02:32:23.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.373+0000 7fbfdb000640 1 -- start start 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfdb000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbfd40af580 0x7fbfd40af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfdb000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40aff20 con 0x7fbfd4155980 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfdb000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd4158400 con 0x7fbfd40a54d0 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfdb000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd41577f0 con 0x7fbfd40af580 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfd3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbfd4155980 0x7fbfd4156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:37318/0 (socket says 172.21.15.110:37318) 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.374+0000 7fbfd3e00640 1 -- 172.21.15.110:0/2419672330 learned_addr learned my addr 172.21.15.110:0/2419672330 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:23.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd9000640 1 --2- 172.21.15.110:0/2419672330 >> v2:172.21.15.177:3300/0 conn(0x7fbfd40af580 0x7fbfd40af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257621590 0 0) 0x7fbfc4001110 con 0x7fbfd4155980 2024-08-17T02:32:23.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb80034e0 con 0x7fbfd4155980 2024-08-17T02:32:23.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896729080 0 0) 0x7fbfb80034e0 con 0x7fbfd4155980 2024-08-17T02:32:23.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 >> v2:172.21.15.177:3300/0 conn(0x7fbfd40af580 msgr2=0x7fbfd40af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 --2- 172.21.15.110:0/2419672330 >> v2:172.21.15.177:3300/0 conn(0x7fbfd40af580 0x7fbfd40af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 >> v1:172.21.15.177:6789/0 conn(0x7fbfd40a54d0 legacy=0x7fbfd4155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4157ad0 con 0x7fbfd4155980 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fbfc4001600 con 0x7fbfd4155980 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 >> v1:172.21.15.110:6789/0 conn(0x7fbfd4155980 legacy=0x7fbfd4156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfb80039d0 0x7fbfb8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfb8004780 0x7fbfb8004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41577f0 con 0x7fbfb8005130 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb800c040 con 0x7fbfb8004780 2024-08-17T02:32:23.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.375+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb800c200 con 0x7fbfb80039d0 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd3e00640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfb80039d0 0x7fbfb8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfcb400640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfb8004780 0x7fbfb8004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 -- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfb80039d0 msgr2=0x7fbfb8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfb80039d0 0x7fbfb8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 -- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfb8004780 msgr2=0x7fbfb8004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfb8004780 0x7fbfb8004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.376+0000 7fbfd9000640 1 -- 172.21.15.110:0/2419672330 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80034e0 con 0x7fbfb8005130 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.377+0000 7fbfd9000640 1 -- 172.21.15.110:0/2419672330 reap_dead start 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.377+0000 7fbfd9000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfb800b9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00e210 tx=0x7fbfcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be8a87aff79ff9c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.377+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc02c040 con 0x7fbfb8005130 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.377+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc00f040 con 0x7fbfb8005130 2024-08-17T02:32:23.379 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.377+0000 7fbfd3400640 1 -- 172.21.15.110:0/2419672330 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc030650 con 0x7fbfb8005130 2024-08-17T02:32:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 -- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 msgr2=0x7fbfb800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfb800b9d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00e210 tx=0x7fbfcc00b040 comp rx=0 tx=0).stop 2024-08-17T02:32:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 -- 172.21.15.110:0/2419672330 shutdown_connections 2024-08-17T02:32:23.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 --2- 172.21.15.110:0/2419672330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfb800b9d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 -- 172.21.15.110:0/2419672330 >> 172.21.15.110:0/2419672330 conn(0x7fbfd4067750 msgr2=0x7fbfd40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 -- 172.21.15.110:0/2419672330 shutdown_connections 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.378+0000 7fbfdb000640 1 -- 172.21.15.110:0/2419672330 wait complete. 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.379+0000 7fbfdb000640 1 Processor -- start 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.379+0000 7fbfdb000640 1 -- start start 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 0x7fbfd415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd40a6480 0x7fbfd4167200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415c100 con 0x7fbfb8005130 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415c3e0 con 0x7fbfd415b990 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfdb000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415c6c0 con 0x7fbfd40a6480 2024-08-17T02:32:23.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfd3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfd3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50678/0 (socket says 172.21.15.110:50678) 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.380+0000 7fbfd3e00640 1 -- 172.21.15.110:0/390792483 learned_addr learned my addr 172.21.15.110:0/390792483 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfcb400640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 0x7fbfd415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd9000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd40a6480 0x7fbfd4167200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 -- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd40a6480 msgr2=0x7fbfd4167200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd40a6480 0x7fbfd4167200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 -- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 msgr2=0x7fbfd415d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 0x7fbfd415d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 -- 172.21.15.110:0/390792483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd415c9a0 con 0x7fbfb8005130 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfcb400640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 0x7fbfd415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfd3e00640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007ad0 tx=0x7fbfc40079c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4018030 con 0x7fbfb8005130 2024-08-17T02:32:23.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc400f990 con 0x7fbfb8005130 2024-08-17T02:32:23.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400fd50 con 0x7fbfb8005130 2024-08-17T02:32:23.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.381+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd415cc80 con 0x7fbfb8005130 2024-08-17T02:32:23.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.382+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd415d6c0 con 0x7fbfb8005130 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.383+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd415d850 con 0x7fbfb8005130 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.383+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbfc401b070 con 0x7fbfb8005130 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.384+0000 7fbfcbe00640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 0x7fbfb0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.384+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fbfc4019070 con 0x7fbfb8005130 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.384+0000 7fbfcb400640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 0x7fbfb0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:23.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.385+0000 7fbfcb400640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 0x7fbfb0067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000f60 tx=0x7fbfbc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:23.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.388+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbfc4050290 con 0x7fbfb8005130 2024-08-17T02:32:23.597 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:23.597+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbfd40aff20 con 0x7fbfb8005130 2024-08-17T02:32:24.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.204+0000 7fbfcbe00640 1 -- 172.21.15.110:0/390792483 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbfd40aff20 con 0x7fbfb8005130 2024-08-17T02:32:24.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 msgr2=0x7fbfb0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 0x7fbfb0067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc000f60 tx=0x7fbfbc009040 comp rx=0 tx=0).stop 2024-08-17T02:32:24.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 msgr2=0x7fbfd40cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007ad0 tx=0x7fbfc40079c0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 shutdown_connections 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fbfb0065150 0x7fbfb0067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbfd40a6480 0x7fbfd4167200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbfd415b990 0x7fbfd415d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 --2- 172.21.15.110:0/390792483 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb8005130 0x7fbfd40cafe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 >> 172.21.15.110:0/390792483 conn(0x7fbfd4067750 msgr2=0x7fbfd406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 shutdown_connections 2024-08-17T02:32:24.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.207+0000 7fbfdb000640 1 -- 172.21.15.110:0/390792483 wait complete. 2024-08-17T02:32:24.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:32:24.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.417+0000 7f8b85a00640 1 Processor -- start 2024-08-17T02:32:24.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.417+0000 7f8b85a00640 1 -- start start 2024-08-17T02:32:24.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 0x7f8b800b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8b800b5740 0x7f8b8015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b800d0a80 con 0x7f8b8015c2e0 2024-08-17T02:32:24.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b800b2130 con 0x7f8b800b5740 2024-08-17T02:32:24.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015c720 con 0x7f8b800b2bb0 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8b8015c2e0 0x7f8b800b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49806/0 (socket says 172.21.15.110:49806) 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b85000640 1 -- 172.21.15.110:0/2683801771 learned_addr learned my addr 172.21.15.110:0/2683801771 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2683801771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 0x7f8b800b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.418+0000 7f8b77400640 1 --2- 172.21.15.110:0/2683801771 >> v2:172.21.15.177:3300/0 conn(0x7f8b800b5740 0x7f8b8015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7f400640 1 -- 172.21.15.110:0/2683801771 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155157885 0 0) 0x7f8b800d0a80 con 0x7f8b8015c2e0 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7f400640 1 -- 172.21.15.110:0/2683801771 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b640034e0 con 0x7f8b8015c2e0 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2683801771 >> v2:172.21.15.177:3300/0 conn(0x7f8b800b5740 msgr2=0x7f8b8015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2683801771 >> v2:172.21.15.177:3300/0 conn(0x7f8b800b5740 0x7f8b8015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2683801771 >> v1:172.21.15.110:6789/0 conn(0x7f8b8015c2e0 legacy=0x7f8b800b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.419+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2683801771 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800b23f0 con 0x7f8b800b2bb0 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.420+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2683801771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 0x7f8b800b2f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009850 tx=0x7f8b700090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e643b59d359ffe8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.420+0000 7f8b7f400640 1 -- 172.21.15.110:0/2683801771 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7002ae10 con 0x7f8b800b2bb0 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.420+0000 7f8b7f400640 1 -- 172.21.15.110:0/2683801771 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70032440 con 0x7f8b800b2bb0 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.420+0000 7f8b7f400640 1 -- 172.21.15.110:0/2683801771 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70032820 con 0x7f8b800b2bb0 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 -- 172.21.15.110:0/2683801771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 msgr2=0x7f8b800b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2683801771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 0x7f8b800b2f80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009850 tx=0x7f8b700090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 -- 172.21.15.110:0/2683801771 shutdown_connections 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2683801771 >> v2:172.21.15.177:3300/0 conn(0x7f8b800b5740 0x7f8b8015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2683801771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b800b2bb0 0x7f8b800b2f80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 -- 172.21.15.110:0/2683801771 >> 172.21.15.110:0/2683801771 conn(0x7f8b800cfbc0 msgr2=0x7f8b800cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:24.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 -- 172.21.15.110:0/2683801771 shutdown_connections 2024-08-17T02:32:24.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.421+0000 7f8b85a00640 1 -- 172.21.15.110:0/2683801771 wait complete. 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.422+0000 7f8b85a00640 1 Processor -- start 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.422+0000 7f8b85a00640 1 -- start start 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b800b5740 0x7f8b80159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 0x7f8b80159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8016d470 con 0x7f8b800b2bb0 2024-08-17T02:32:24.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8016c7f0 con 0x7f8b800b5740 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b85a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8016cad0 con 0x7f8b8015c2e0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b7fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50146/0 (socket says 172.21.15.110:50146) 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.423+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2900013140 learned_addr learned my addr 172.21.15.110:0/2900013140 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b85000640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 0x7f8b80159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 msgr2=0x7f8b80159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 0x7f8b80159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b800b5740 msgr2=0x7f8b80159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b800b5740 0x7f8b80159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 -- 172.21.15.110:0/2900013140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70009390 con 0x7f8b800b2bb0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b85000640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 0x7f8b80159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b7fe00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009360 tx=0x7f8b70032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b70031c20 con 0x7f8b800b2bb0 2024-08-17T02:32:24.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b70031d80 con 0x7f8b800b2bb0 2024-08-17T02:32:24.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7003d670 con 0x7f8b800b2bb0 2024-08-17T02:32:24.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.424+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8016cdb0 con 0x7f8b800b2bb0 2024-08-17T02:32:24.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.425+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b80145310 con 0x7f8b800b2bb0 2024-08-17T02:32:24.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.426+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b80145500 con 0x7f8b800b2bb0 2024-08-17T02:32:24.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.426+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8b70039040 con 0x7f8b800b2bb0 2024-08-17T02:32:24.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.428+0000 7f8b77e00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 0x7f8b5c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:24.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.428+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f8b700a2700 con 0x7f8b800b2bb0 2024-08-17T02:32:24.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.428+0000 7f8b77400640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 0x7f8b5c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:24.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.428+0000 7f8b77400640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 0x7f8b5c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b8009d980 tx=0x7f8b680090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:24.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.432+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8b80145500 con 0x7f8b800b2bb0 2024-08-17T02:32:24.605 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:24.603+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8b8016cc10 con 0x7f8b800b2bb0 2024-08-17T02:32:25.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.207+0000 7f8b77e00640 1 -- 172.21.15.110:0/2900013140 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8b8016cc10 con 0x7f8b800b2bb0 2024-08-17T02:32:25.208 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 msgr2=0x7f8b5c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 0x7f8b5c067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b8009d980 tx=0x7f8b680090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 msgr2=0x7f8b80144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009360 tx=0x7f8b70032000 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 shutdown_connections 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8b5c065150 0x7f8b5c067600 secure :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8b8009d980 tx=0x7f8b680090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b8015c2e0 0x7f8b80159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b800b5740 0x7f8b80159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 --2- 172.21.15.110:0/2900013140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b800b2bb0 0x7f8b80144dd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.212+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 >> 172.21.15.110:0/2900013140 conn(0x7f8b800cfbc0 msgr2=0x7f8b80068c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:25.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.213+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 shutdown_connections 2024-08-17T02:32:25.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.213+0000 7f8b85a00640 1 -- 172.21.15.110:0/2900013140 wait complete. 2024-08-17T02:32:25.234 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:32:25.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.384+0000 7faf81800640 1 Processor -- start 2024-08-17T02:32:25.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.384+0000 7faf81800640 1 -- start start 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf81800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf7c0adbb0 0x7faf7c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf81800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0aec80 con 0x7faf7c157140 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf81800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c0cc6a0 con 0x7faf7c1510b0 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf81800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7c0af650 con 0x7faf7c0adbb0 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf73400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf7c0adbb0 0x7faf7c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf73400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faf7c0adbb0 0x7faf7c0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50160/0 (socket says 172.21.15.110:50160) 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf73400640 1 -- 172.21.15.110:0/2237623637 learned_addr learned my addr 172.21.15.110:0/2237623637 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.385+0000 7faf80e00640 1 --1- 172.21.15.110:0/2237623637 >> v1:172.21.15.110:6789/0 conn(0x7faf7c157140 0x7faf7c1575a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49810/0 (socket says 172.21.15.110:49810) 2024-08-17T02:32:25.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.386+0000 7faf73400640 1 -- 172.21.15.110:0/2237623637 >> v1:172.21.15.177:6789/0 conn(0x7faf7c1510b0 legacy=0x7faf7c0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:25.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.386+0000 7faf73400640 1 -- 172.21.15.110:0/2237623637 >> v1:172.21.15.110:6789/0 conn(0x7faf7c157140 legacy=0x7faf7c1575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.386+0000 7faf73400640 1 -- 172.21.15.110:0/2237623637 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c157d70 con 0x7faf7c0adbb0 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf73400640 1 --2- 172.21.15.110:0/2237623637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0af110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf64009910 tx=0x7faf640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c3f1e391899ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf7b400640 1 -- 172.21.15.110:0/2237623637 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6402ae70 con 0x7faf7c0adbb0 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf7b400640 1 -- 172.21.15.110:0/2237623637 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf64032440 con 0x7faf7c0adbb0 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf7b400640 1 -- 172.21.15.110:0/2237623637 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf64032820 con 0x7faf7c0adbb0 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf81800640 1 -- 172.21.15.110:0/2237623637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 msgr2=0x7faf7c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf81800640 1 --2- 172.21.15.110:0/2237623637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0af110 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf64009910 tx=0x7faf640091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf81800640 1 -- 172.21.15.110:0/2237623637 shutdown_connections 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf81800640 1 --2- 172.21.15.110:0/2237623637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0af110 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.387+0000 7faf81800640 1 -- 172.21.15.110:0/2237623637 >> 172.21.15.110:0/2237623637 conn(0x7faf7c067750 msgr2=0x7faf7c0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.388+0000 7faf81800640 1 -- 172.21.15.110:0/2237623637 shutdown_connections 2024-08-17T02:32:25.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.388+0000 7faf81800640 1 -- 172.21.15.110:0/2237623637 wait complete. 2024-08-17T02:32:25.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.389+0000 7faf81800640 1 Processor -- start 2024-08-17T02:32:25.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.389+0000 7faf81800640 1 -- start start 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf7c1510b0 0x7faf7c156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 0x7faf7c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0c76b0 con 0x7faf7c0adbb0 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c154960 con 0x7faf7c157140 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf81800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c154030 con 0x7faf7c1510b0 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50166/0 (socket says 172.21.15.110:50166) 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 -- 172.21.15.110:0/3597886437 learned_addr learned my addr 172.21.15.110:0/3597886437 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf80e00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 0x7faf7c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf73400640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf7c1510b0 0x7faf7c156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:25.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 -- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf7c1510b0 msgr2=0x7faf7c156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf7c1510b0 0x7faf7c156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 -- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 msgr2=0x7faf7c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 0x7faf7c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf7be00640 1 -- 172.21.15.110:0/3597886437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf64009450 con 0x7faf7c0adbb0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.390+0000 7faf80e00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 0x7faf7c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf7be00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c610 tx=0x7faf6c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c007020 con 0x7faf7c0adbb0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c0071a0 con 0x7faf7c0adbb0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c007560 con 0x7faf7c0adbb0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c154310 con 0x7faf7c0adbb0 2024-08-17T02:32:25.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.391+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c16a020 con 0x7faf7c0adbb0 2024-08-17T02:32:25.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.392+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c071050 con 0x7faf7c0adbb0 2024-08-17T02:32:25.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.393+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7faf6c0069a0 con 0x7faf7c0adbb0 2024-08-17T02:32:25.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.394+0000 7faf73e00640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 0x7faf58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:25.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.394+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6251+0+0 (secure 0 0 0) 0x7faf6c0822c0 con 0x7faf7c0adbb0 2024-08-17T02:32:25.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.394+0000 7faf73400640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 0x7faf58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:25.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.394+0000 7faf73400640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 0x7faf58067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf64034000 tx=0x7faf64032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:25.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.397+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faf6c050160 con 0x7faf7c0adbb0 2024-08-17T02:32:25.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:25.572+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf7c0aa200 con 0x7faf7c0adbb0 2024-08-17T02:32:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.213+0000 7faf73e00640 1 -- 172.21.15.110:0/3597886437 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7faf6c053780 con 0x7faf7c0adbb0 2024-08-17T02:32:26.215 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs_data' removed 2024-08-17T02:32:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.217+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 msgr2=0x7faf58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.217+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 0x7faf58067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf64034000 tx=0x7faf64032000 comp rx=0 tx=0).stop 2024-08-17T02:32:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.217+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 msgr2=0x7faf7c0c7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.217+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00c610 tx=0x7faf6c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 shutdown_connections 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7faf58065150 0x7faf58067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf7c157140 0x7faf7c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf7c1510b0 0x7faf7c156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 --2- 172.21.15.110:0/3597886437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf7c0adbb0 0x7faf7c0c7170 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.218+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 >> 172.21.15.110:0/3597886437 conn(0x7faf7c067750 msgr2=0x7faf7c06db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:26.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.219+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 shutdown_connections 2024-08-17T02:32:26.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.219+0000 7faf81800640 1 -- 172.21.15.110:0/3597886437 wait complete. 2024-08-17T02:32:26.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:26.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.386+0000 7fe313600640 1 Processor -- start 2024-08-17T02:32:26.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.386+0000 7fe313600640 1 -- start start 2024-08-17T02:32:26.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.387+0000 7fe313600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe30c155550 0x7fe30c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.387+0000 7fe313600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 0x7fe30c06e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.387+0000 7fe313600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c0afc10 con 0x7fe30c155180 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.387+0000 7fe313600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c06ea00 con 0x7fe30c155550 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.387+0000 7fe313600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0af000 con 0x7fe30c06e080 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.388+0000 7fe311600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 0x7fe30c06e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.388+0000 7fe30be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe30c155550 0x7fe30c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.388+0000 7fe310c00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe30c155180 0x7fe30c0ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:50342/0 (socket says 172.21.15.110:50342) 2024-08-17T02:32:26.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.388+0000 7fe310c00640 1 -- 172.21.15.110:0/2812424496 learned_addr learned my addr 172.21.15.110:0/2812424496 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:26.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe30be00640 1 -- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 msgr2=0x7fe30c06e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:26.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe30be00640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 0x7fe30c06e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe30be00640 1 -- 172.21.15.110:0/2812424496 >> v1:172.21.15.177:6789/0 conn(0x7fe30c155180 legacy=0x7fe30c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe30be00640 1 -- 172.21.15.110:0/2812424496 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0af2e0 con 0x7fe30c155550 2024-08-17T02:32:26.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe30b400640 1 -- 172.21.15.110:0/2812424496 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159259130 0 0) 0x7fe30c0afc10 con 0x7fe30c155180 2024-08-17T02:32:26.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.389+0000 7fe311600640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 0x7fe30c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:26.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.390+0000 7fe30be00640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0aea20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009880 tx=0x7fe2f80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f6dd156e816203 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.390+0000 7fe30b400640 1 -- 172.21.15.110:0/2812424496 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f802ad70 con 0x7fe30c155550 2024-08-17T02:32:26.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.390+0000 7fe30b400640 1 -- 172.21.15.110:0/2812424496 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8032440 con 0x7fe30c155550 2024-08-17T02:32:26.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.390+0000 7fe30b400640 1 -- 172.21.15.110:0/2812424496 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80327e0 con 0x7fe30c155550 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 -- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 msgr2=0x7fe30c0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0aea20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8009880 tx=0x7fe2f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 -- 172.21.15.110:0/2812424496 shutdown_connections 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c06e080 0x7fe30c06e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 --2- 172.21.15.110:0/2812424496 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0aea20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 -- 172.21.15.110:0/2812424496 >> 172.21.15.110:0/2812424496 conn(0x7fe30c0cb9b0 msgr2=0x7fe30c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 -- 172.21.15.110:0/2812424496 shutdown_connections 2024-08-17T02:32:26.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.391+0000 7fe313600640 1 -- 172.21.15.110:0/2812424496 wait complete. 2024-08-17T02:32:26.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.392+0000 7fe313600640 1 Processor -- start 2024-08-17T02:32:26.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 -- start start 2024-08-17T02:32:26.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c155180 0x7fe30c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0a6f20 con 0x7fe30c06e080 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c167cf0 con 0x7fe30c155550 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.393+0000 7fe313600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0a6420 con 0x7fe30c155180 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50182/0 (socket says 172.21.15.110:50182) 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 -- 172.21.15.110:0/2443031939 learned_addr learned my addr 172.21.15.110:0/2443031939 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe30be00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c155180 0x7fe30c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe311600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 -- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c155180 msgr2=0x7fe30c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c155180 0x7fe30c0c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 -- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 msgr2=0x7fe30c0c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 -- 172.21.15.110:0/2443031939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009a20 con 0x7fe30c06e080 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe311600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.394+0000 7fe310c00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c5c0 tx=0x7fe300007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.395+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300005aa0 con 0x7fe30c06e080 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.395+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300005c00 con 0x7fe30c06e080 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.395+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f8009390 con 0x7fe30c06e080 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.395+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000070f0 con 0x7fe30c06e080 2024-08-17T02:32:26.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.395+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0a6960 con 0x7fe30c06e080 2024-08-17T02:32:26.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.396+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c0ae5f0 con 0x7fe30c06e080 2024-08-17T02:32:26.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.396+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe300007520 con 0x7fe30c06e080 2024-08-17T02:32:26.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.397+0000 7fe2ffe00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 0x7fe2ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.397+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fe300081fd0 con 0x7fe30c06e080 2024-08-17T02:32:26.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.397+0000 7fe30be00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 0x7fe2ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.398+0000 7fe30be00640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 0x7fe2ec067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8034000 tx=0x7fe2f8032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.402 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.401+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe30c0ae5f0 con 0x7fe30c06e080 2024-08-17T02:32:26.585 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.584+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe30c0ae5f0 con 0x7fe30c06e080 2024-08-17T02:32:26.586 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.585+0000 7fe2ffe00640 1 -- 172.21.15.110:0/2443031939 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fe30c0ae5f0 con 0x7fe30c06e080 2024-08-17T02:32:26.586 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:26.587 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":41,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:32:26.207272+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/3374805694":"2024-08-18T02:32:23.197580+0000","172.21.15.110:6834/3374805694":"2024-08-18T02:32:23.197580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 msgr2=0x7fe2ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 0x7fe2ec067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8034000 tx=0x7fe2f8032000 comp rx=0 tx=0).stop 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 msgr2=0x7fe30c0a5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c5c0 tx=0x7fe300007d40 comp rx=0 tx=0).stop 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 shutdown_connections 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fe2ec065150 0x7fe2ec067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe30c155550 0x7fe30c0c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe30c155180 0x7fe30c0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.589 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 --2- 172.21.15.110:0/2443031939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c06e080 0x7fe30c0a5ee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 >> 172.21.15.110:0/2443031939 conn(0x7fe30c0cb9b0 msgr2=0x7fe30c0c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:26.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 shutdown_connections 2024-08-17T02:32:26.590 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.587+0000 7fe313600640 1 -- 172.21.15.110:0/2443031939 wait complete. 2024-08-17T02:32:26.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:29:03.489892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000013181.meta', 'create_time': '2024-08-17T02:30:13.947037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000013181'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000013181.data', 'create_time': '2024-08-17T02:30:14.843060+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000013181'}}}] 2024-08-17T02:32:26.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:32:26.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.754+0000 7f5577200640 1 Processor -- start 2024-08-17T02:32:26.756 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.754+0000 7f5577200640 1 -- start start 2024-08-17T02:32:26.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5577200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 0x7f557806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5577200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55780ab010 0x7f55780ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.757 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5577200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780af5f0 con 0x7f557815a0e0 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5577200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5578159600 con 0x7f55780ab010 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5577200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55781598e0 con 0x7f557806df00 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5576800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55780ab010 0x7f55780ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5576800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55780ab010 0x7f55780ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50192/0 (socket says 172.21.15.110:50192) 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5576800640 1 -- 172.21.15.110:0/2200748914 learned_addr learned my addr 172.21.15.110:0/2200748914 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:26.758 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f556d400640 1 --1- 172.21.15.110:0/2200748914 >> v1:172.21.15.110:6789/0 conn(0x7f557815a0e0 0x7f55780aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49818/0 (socket says 172.21.15.110:49818) 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5575e00640 1 --2- 172.21.15.110:0/2200748914 >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 0x7f557806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.756+0000 7f5576800640 1 -- 172.21.15.110:0/2200748914 >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 msgr2=0x7f557806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.757+0000 7f5576800640 1 --2- 172.21.15.110:0/2200748914 >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 0x7f557806e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.757+0000 7f5576800640 1 -- 172.21.15.110:0/2200748914 >> v1:172.21.15.110:6789/0 conn(0x7f557815a0e0 legacy=0x7f55780aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.757+0000 7f5576800640 1 -- 172.21.15.110:0/2200748914 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578159bc0 con 0x7f55780ab010 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.757+0000 7f5575e00640 1 --2- 172.21.15.110:0/2200748914 >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 0x7f557806e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.757+0000 7f5576800640 1 --2- 172.21.15.110:0/2200748914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55780ab010 0x7f55780ae8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5578060670 tx=0x7f5570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f52687cb996f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5575400640 1 -- 172.21.15.110:0/2200748914 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570031400 con 0x7f55780ab010 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5575400640 1 -- 172.21.15.110:0/2200748914 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557002d050 con 0x7f55780ab010 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5575400640 1 -- 172.21.15.110:0/2200748914 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570031790 con 0x7f55780ab010 2024-08-17T02:32:26.760 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 -- 172.21.15.110:0/2200748914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55780ab010 msgr2=0x7f55780ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 --2- 172.21.15.110:0/2200748914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55780ab010 0x7f55780ae8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5578060670 tx=0x7f5570009840 comp rx=0 tx=0).stop 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 -- 172.21.15.110:0/2200748914 shutdown_connections 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 --2- 172.21.15.110:0/2200748914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55780ab010 0x7f55780ae8c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 --2- 172.21.15.110:0/2200748914 >> v2:172.21.15.177:3300/0 conn(0x7f557806df00 0x7f557806e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 -- 172.21.15.110:0/2200748914 >> 172.21.15.110:0/2200748914 conn(0x7f5578067750 msgr2=0x7f557806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.758+0000 7f5577200640 1 -- 172.21.15.110:0/2200748914 shutdown_connections 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.759+0000 7f5577200640 1 -- 172.21.15.110:0/2200748914 wait complete. 2024-08-17T02:32:26.761 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.760+0000 7f5577200640 1 Processor -- start 2024-08-17T02:32:26.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.760+0000 7f5577200640 1 -- start start 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 0x7f55781420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 0x7f5578152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578169dd0 con 0x7f557815a0e0 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55781691c0 con 0x7f557806df00 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5577200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55781694a0 con 0x7f55780ab010 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5576800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5576800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50200/0 (socket says 172.21.15.110:50200) 2024-08-17T02:32:26.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.761+0000 7f5576800640 1 -- 172.21.15.110:0/1550759848 learned_addr learned my addr 172.21.15.110:0/1550759848 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f556d400640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 0x7f5578152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5575e00640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 0x7f55781420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 -- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 msgr2=0x7f5578152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 0x7f5578152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 -- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 msgr2=0x7f55781420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 0x7f55781420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 -- 172.21.15.110:0/1550759848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5570009ae0 con 0x7f557815a0e0 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f556d400640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 0x7f5578152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5575e00640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 0x7f55781420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5576800640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5570009f50 tx=0x7f5570036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570031780 con 0x7f557815a0e0 2024-08-17T02:32:26.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570008ad0 con 0x7f557815a0e0 2024-08-17T02:32:26.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570008e90 con 0x7f557815a0e0 2024-08-17T02:32:26.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578169780 con 0x7f557815a0e0 2024-08-17T02:32:26.766 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.762+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578142620 con 0x7f557815a0e0 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.763+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5578071050 con 0x7f557815a0e0 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.764+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5570038050 con 0x7f557815a0e0 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.765+0000 7f556e000640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.765+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f55700a2f60 con 0x7f557815a0e0 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.765+0000 7f5575e00640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:26.767 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.766+0000 7f5575e00640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 0x7f5554067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5578158ed0 tx=0x7f5568008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:26.770 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.769+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5570070f00 con 0x7f557815a0e0 2024-08-17T02:32:26.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.941+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55780ad9a0 con 0x7f557815a0e0 2024-08-17T02:32:26.942 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.941+0000 7f556e000640 1 -- 172.21.15.110:0/1550759848 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5570049020 con 0x7f557815a0e0 2024-08-17T02:32:26.943 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 1 2024-08-17T02:32:26.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 msgr2=0x7f5554067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 0x7f5554067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5578158ed0 tx=0x7f5568008040 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 msgr2=0x7f5578154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5570009f50 tx=0x7f5570036000 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 shutdown_connections 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5554065150 0x7f5554067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f557815a0e0 0x7f5578154d20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55780ab010 0x7f5578152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 --2- 172.21.15.110:0/1550759848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f557806df00 0x7f55781420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 >> 172.21.15.110:0/1550759848 conn(0x7f5578067750 msgr2=0x7f55780c8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:26.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 shutdown_connections 2024-08-17T02:32:26.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:26.943+0000 7f5577200640 1 -- 172.21.15.110:0/1550759848 wait complete. 2024-08-17T02:32:26.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000013181.meta pg_num 2024-08-17T02:32:27.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.109+0000 7efe0c600640 1 Processor -- start 2024-08-17T02:32:27.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.109+0000 7efe0c600640 1 -- start start 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe04155a80 0x7efe0406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe040c7db0 0x7efe040c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe04155e50 0x7efe040c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe041598f0 con 0x7efe040c7db0 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe04159bd0 con 0x7efe04155e50 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0c600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04159eb0 con 0x7efe04155a80 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe040c7db0 0x7efe040c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe040c7db0 0x7efe040c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50204/0 (socket says 172.21.15.110:50204) 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 -- 172.21.15.110:0/1455680421 learned_addr learned my addr 172.21.15.110:0/1455680421 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe0a600640 1 --2- 172.21.15.110:0/1455680421 >> v2:172.21.15.177:3300/0 conn(0x7efe04155e50 0x7efe040c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09c00640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe04155a80 0x7efe0406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 -- 172.21.15.110:0/1455680421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe04155a80 msgr2=0x7efe0406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe04155a80 0x7efe0406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 -- 172.21.15.110:0/1455680421 >> v2:172.21.15.177:3300/0 conn(0x7efe04155e50 msgr2=0x7efe040c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 --2- 172.21.15.110:0/1455680421 >> v2:172.21.15.177:3300/0 conn(0x7efe04155e50 0x7efe040c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.111+0000 7efe09200640 1 -- 172.21.15.110:0/1455680421 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0415a190 con 0x7efe040c7db0 2024-08-17T02:32:27.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.112+0000 7efe09200640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe040c7db0 0x7efe040c8bd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efe04070b00 tx=0x7efdf00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd47cc17b43c6be server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe03e00640 1 -- 172.21.15.110:0/1455680421 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf002add0 con 0x7efe040c7db0 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe03e00640 1 -- 172.21.15.110:0/1455680421 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0032440 con 0x7efe040c7db0 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe03e00640 1 -- 172.21.15.110:0/1455680421 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0032820 con 0x7efe040c7db0 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 -- 172.21.15.110:0/1455680421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe040c7db0 msgr2=0x7efe040c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe040c7db0 0x7efe040c8bd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7efe04070b00 tx=0x7efdf00091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 -- 172.21.15.110:0/1455680421 shutdown_connections 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 --2- 172.21.15.110:0/1455680421 >> v2:172.21.15.177:3300/0 conn(0x7efe04155e50 0x7efe040c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe040c7db0 0x7efe040c8bd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 --2- 172.21.15.110:0/1455680421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe04155a80 0x7efe0406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.113+0000 7efe0c600640 1 -- 172.21.15.110:0/1455680421 >> 172.21.15.110:0/1455680421 conn(0x7efe04067750 msgr2=0x7efe040c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.114+0000 7efe0c600640 1 -- 172.21.15.110:0/1455680421 shutdown_connections 2024-08-17T02:32:27.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.114+0000 7efe0c600640 1 -- 172.21.15.110:0/1455680421 wait complete. 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.115+0000 7efe0c600640 1 Processor -- start 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.115+0000 7efe0c600640 1 -- start start 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 0x7efe0414a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe04155a80 0x7efe04156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04171460 con 0x7efe04155e50 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04157570 con 0x7efe04155a80 2024-08-17T02:32:27.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0c600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04170b30 con 0x7efe040c7db0 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50212/0 (socket says 172.21.15.110:50212) 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe0a600640 1 -- 172.21.15.110:0/3746671787 learned_addr learned my addr 172.21.15.110:0/3746671787 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe09200640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe04155a80 0x7efe04156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.116+0000 7efe09c00640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 0x7efe0414a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 -- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 msgr2=0x7efe0414a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 0x7efe0414a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 -- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe04155a80 msgr2=0x7efe04156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe04155a80 0x7efe04156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 -- 172.21.15.110:0/3746671787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0009450 con 0x7efe04155e50 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe09c00640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 0x7efe0414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:27.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0a600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efdfc007f20 tx=0x7efdfc009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ee30 con 0x7efe04155e50 2024-08-17T02:32:27.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc014420 con 0x7efe04155e50 2024-08-17T02:32:27.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0147e0 con 0x7efe04155e50 2024-08-17T02:32:27.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe04170e10 con 0x7efe04155e50 2024-08-17T02:32:27.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.117+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe041718f0 con 0x7efe04155e50 2024-08-17T02:32:27.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.118+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe041715d0 con 0x7efe04155e50 2024-08-17T02:32:27.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.119+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efdfc014b50 con 0x7efe04155e50 2024-08-17T02:32:27.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.120+0000 7efe00c00640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 0x7efde4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.120+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7efdfc082c20 con 0x7efe04155e50 2024-08-17T02:32:27.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.120+0000 7efe09c00640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 0x7efde4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.123 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.121+0000 7efe09c00640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 0x7efde4067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efdf800bb80 tx=0x7efdf8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.125 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.124+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efdfc050bc0 con 0x7efe04155e50 2024-08-17T02:32:27.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.297+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.meta", "var": "pg_num"} v 0) v1 -- 0x7efe04071050 con 0x7efe04155e50 2024-08-17T02:32:27.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.297+0000 7efe00c00640 1 -- 172.21.15.110:0/3746671787 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.meta", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7efdfc0541e0 con 0x7efe04155e50 2024-08-17T02:32:27.299 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 msgr2=0x7efde4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 0x7efde4067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efdf800bb80 tx=0x7efdf8008040 comp rx=0 tx=0).stop 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 msgr2=0x7efe040ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7efdfc007f20 tx=0x7efdfc009860 comp rx=0 tx=0).stop 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 shutdown_connections 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7efde4065150 0x7efde4067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe04155e50 0x7efe040ae9b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe04155a80 0x7efe04156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.301 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 --2- 172.21.15.110:0/3746671787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe040c7db0 0x7efe0414a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 >> 172.21.15.110:0/3746671787 conn(0x7efe04067750 msgr2=0x7efe040cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:27.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 shutdown_connections 2024-08-17T02:32:27.302 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.299+0000 7efe0c600640 1 -- 172.21.15.110:0/3746671787 wait complete. 2024-08-17T02:32:27.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000013181.data pg_num 2024-08-17T02:32:27.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.465+0000 7ff2d2c00640 1 Processor -- start 2024-08-17T02:32:27.466 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.465+0000 7ff2d2c00640 1 -- start start 2024-08-17T02:32:27.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2cc156c50 0x7ff2cc0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc0ab130 con 0x7ff2cc0abb00 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc0ae5a0 con 0x7ff2cc156c50 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d2c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc0ae2c0 con 0x7ff2cc0adcf0 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.466+0000 7ff2d0c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50222/0 (socket says 172.21.15.110:50222) 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 -- 172.21.15.110:0/3742437322 learned_addr learned my addr 172.21.15.110:0/3742437322 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2cbe00640 1 --2- 172.21.15.110:0/3742437322 >> v2:172.21.15.177:3300/0 conn(0x7ff2cc156c50 0x7ff2cc0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2cb400640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 -- 172.21.15.110:0/3742437322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 msgr2=0x7ff2cc0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc0ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 -- 172.21.15.110:0/3742437322 >> v2:172.21.15.177:3300/0 conn(0x7ff2cc156c50 msgr2=0x7ff2cc0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 --2- 172.21.15.110:0/3742437322 >> v2:172.21.15.177:3300/0 conn(0x7ff2cc156c50 0x7ff2cc0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.467+0000 7ff2d0c00640 1 -- 172.21.15.110:0/3742437322 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc0aaae0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.468+0000 7ff2d0c00640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06efd0 tx=0x7ff2c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eabb15799626116 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.468+0000 7ff2caa00640 1 -- 172.21.15.110:0/3742437322 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4031400 con 0x7ff2cc0abb00 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.468+0000 7ff2caa00640 1 -- 172.21.15.110:0/3742437322 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c402d050 con 0x7ff2cc0abb00 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.468+0000 7ff2caa00640 1 -- 172.21.15.110:0/3742437322 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40317d0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 -- 172.21.15.110:0/3742437322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 msgr2=0x7ff2cc0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06efd0 tx=0x7ff2c4009840 comp rx=0 tx=0).stop 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 -- 172.21.15.110:0/3742437322 shutdown_connections 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc0c8bd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/3742437322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc0ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/3742437322 >> v2:172.21.15.177:3300/0 conn(0x7ff2cc156c50 0x7ff2cc0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 -- 172.21.15.110:0/3742437322 >> 172.21.15.110:0/3742437322 conn(0x7ff2cc067750 msgr2=0x7ff2cc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 -- 172.21.15.110:0/3742437322 shutdown_connections 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.469+0000 7ff2d2c00640 1 -- 172.21.15.110:0/3742437322 wait complete. 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.471+0000 7ff2d2c00640 1 Processor -- start 2024-08-17T02:32:27.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.471+0000 7ff2d2c00640 1 -- start start 2024-08-17T02:32:27.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.471+0000 7ff2d2c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d2c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc16d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d2c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc156c50 0x7ff2cc13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d2c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc16d890 con 0x7ff2cc0abb00 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d2c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc155050 con 0x7ff2cc156c50 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d2c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc154440 con 0x7ff2cc0adcf0 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50232/0 (socket says 172.21.15.110:50232) 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 -- 172.21.15.110:0/2518716507 learned_addr learned my addr 172.21.15.110:0/2518716507 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cb400640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc16d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2d0c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc156c50 0x7ff2cc13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 -- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 msgr2=0x7ff2cc16d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc16d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 -- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc156c50 msgr2=0x7ff2cc13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc156c50 0x7ff2cc13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 -- 172.21.15.110:0/2518716507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009ae0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.472+0000 7ff2cbe00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e900 tx=0x7ff2bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.473+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00c8e0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.473+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00ca40 con 0x7ff2cc0abb00 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.473+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00cde0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.473+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc154720 con 0x7ff2cc0abb00 2024-08-17T02:32:27.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.473+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc154ce0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.477 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.474+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc155a20 con 0x7ff2cc0abb00 2024-08-17T02:32:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.475+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff2bc013680 con 0x7ff2cc0abb00 2024-08-17T02:32:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.475+0000 7ff2c3400640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 0x7ff2ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.476+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7ff2bc082720 con 0x7ff2cc0abb00 2024-08-17T02:32:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.476+0000 7ff2cb400640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 0x7ff2ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.476+0000 7ff2cb400640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 0x7ff2ac067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc146db0 tx=0x7ff2b8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.479+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff2bc050780 con 0x7ff2cc0abb00 2024-08-17T02:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.650+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.data", "var": "pg_num"} v 0) v1 -- 0x7ff2cc071050 con 0x7ff2cc0abb00 2024-08-17T02:32:27.652 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.651+0000 7ff2c3400640 1 -- 172.21.15.110:0/2518716507 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000013181.data", "var": "pg_num"}]=0 v41) v1 ==== 124+0+11 (secure 0 0 0) 0x7ff2bc053da0 con 0x7ff2cc0abb00 2024-08-17T02:32:27.652 INFO:teuthology.orchestra.run.smithi110.stdout:pg_num: 32 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 msgr2=0x7ff2ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 0x7ff2ac067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc146db0 tx=0x7ff2b8008040 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 msgr2=0x7ff2cc1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e900 tx=0x7ff2bc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 shutdown_connections 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7ff2ac065150 0x7ff2ac067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2cc156c50 0x7ff2cc13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2cc0adcf0 0x7ff2cc16d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 --2- 172.21.15.110:0/2518716507 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2cc0abb00 0x7ff2cc1554e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 >> 172.21.15.110:0/2518716507 conn(0x7ff2cc067750 msgr2=0x7ff2cc1531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 shutdown_connections 2024-08-17T02:32:27.655 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.653+0000 7ff2d2c00640 1 -- 172.21.15.110:0/2518716507 wait complete. 2024-08-17T02:32:27.669 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:27.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.816+0000 7f8cd7e00640 1 Processor -- start 2024-08-17T02:32:27.818 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.817+0000 7f8cd7e00640 1 -- start start 2024-08-17T02:32:27.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 0x7f8cd81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd7e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8157690 con 0x7f8cd8155900 2024-08-17T02:32:27.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd7e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd8156a80 con 0x7f8cd80b0270 2024-08-17T02:32:27.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8156d60 con 0x7f8cd80afdd0 2024-08-17T02:32:27.820 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd6a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8cd8155900 0x7f8cd8155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49834/0 (socket says 172.21.15.110:49834) 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd6a00640 1 -- 172.21.15.110:0/2395885651 learned_addr learned my addr 172.21.15.110:0/2395885651 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.818+0000 7f8cd7400640 1 --2- 172.21.15.110:0/2395885651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 0x7f8cd81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315678429 0 0) 0x7f8cd8157690 con 0x7f8cd8155900 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cbc0034e0 con 0x7f8cd8155900 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd7400640 1 -- 172.21.15.110:0/2395885651 >> v1:172.21.15.177:6789/0 conn(0x7f8cd80b0270 legacy=0x7f8cd80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374281919 0 0) 0x7f8cd8156a80 con 0x7f8cd80b0270 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd7400640 1 -- 172.21.15.110:0/2395885651 >> v1:172.21.15.110:6789/0 conn(0x7f8cd8155900 legacy=0x7f8cd8155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.821 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.819+0000 7f8cd7400640 1 -- 172.21.15.110:0/2395885651 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8157040 con 0x7f8cd80afdd0 2024-08-17T02:32:27.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.820+0000 7f8cd7400640 1 --2- 172.21.15.110:0/2395885651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 0x7f8cd81563e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e90 tx=0x7f8cd0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a19315a6feae0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.820+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc80013f0 con 0x7f8cd80afdd0 2024-08-17T02:32:27.822 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.820+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd002d050 con 0x7f8cd80afdd0 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.820+0000 7f8cd6000640 1 -- 172.21.15.110:0/2395885651 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0031630 con 0x7f8cd80afdd0 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 -- 172.21.15.110:0/2395885651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 msgr2=0x7f8cd81563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/2395885651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 0x7f8cd81563e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e90 tx=0x7f8cd0009780 comp rx=0 tx=0).stop 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 -- 172.21.15.110:0/2395885651 shutdown_connections 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/2395885651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd80afdd0 0x7f8cd81563e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 -- 172.21.15.110:0/2395885651 >> 172.21.15.110:0/2395885651 conn(0x7f8cd8067750 msgr2=0x7f8cd80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 -- 172.21.15.110:0/2395885651 shutdown_connections 2024-08-17T02:32:27.823 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.821+0000 7f8cd7e00640 1 -- 172.21.15.110:0/2395885651 wait complete. 2024-08-17T02:32:27.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.822+0000 7f8cd7e00640 1 Processor -- start 2024-08-17T02:32:27.824 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.822+0000 7f8cd7e00640 1 -- start start 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80afdd0 0x7f8cd81693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd8155900 0x7f8cd80af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8154770 con 0x7f8cd80b0270 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80c9990 con 0x7f8cd80afdd0 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.823+0000 7f8cd7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81698e0 con 0x7f8cd8155900 2024-08-17T02:32:27.825 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50242/0 (socket says 172.21.15.110:50242) 2024-08-17T02:32:27.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 -- 172.21.15.110:0/3720901980 learned_addr learned my addr 172.21.15.110:0/3720901980 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:27.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cd7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd8155900 0x7f8cd80af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.826 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cd6a00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80afdd0 0x7f8cd81693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 -- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd8155900 msgr2=0x7f8cd80af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd8155900 0x7f8cd80af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 -- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80afdd0 msgr2=0x7f8cd81693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80afdd0 0x7f8cd81693a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 -- 172.21.15.110:0/3720901980 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0009a20 con 0x7f8cd80b0270 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.824+0000 7f8cce000640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c7e0 tx=0x7f8cc0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.825+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000a640 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.825+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc000a7c0 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.825+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc000ab80 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.825+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd80c8d80 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.825+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd80c9340 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.826+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80c9b40 con 0x7f8cd80b0270 2024-08-17T02:32:27.828 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.827+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8cc0012420 con 0x7f8cd80b0270 2024-08-17T02:32:27.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.827+0000 7f8ccea00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 0x7f8cb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:27.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.828+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f8cc0081ff0 con 0x7f8cd80b0270 2024-08-17T02:32:27.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.828+0000 7f8cd6a00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 0x7f8cb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:27.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.828+0000 7f8cd6a00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 0x7f8cb4067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001eb0 tx=0x7f8cc8000bc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:27.832 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:27.831+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8cd80c9b40 con 0x7f8cd80b0270 2024-08-17T02:32:28.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.040+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cd80c9b40 con 0x7f8cd80b0270 2024-08-17T02:32:28.042 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.041+0000 7f8ccea00640 1 -- 172.21.15.110:0/3720901980 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f8cd80c9b40 con 0x7f8cd80b0270 2024-08-17T02:32:28.042 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:28.042 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1057905272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1057905272},{"type":"v1","addr":"172.21.15.110:6835","nonce":1057905272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:28.042 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 23 2024-08-17T02:32:28.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 msgr2=0x7f8cb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 0x7f8cb4067600 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001eb0 tx=0x7f8cc8000bc0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.044 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 msgr2=0x7f8cd8146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8cc000c7e0 tx=0x7f8cc0007df0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 shutdown_connections 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8cb4065150 0x7f8cb4067600 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd8155900 0x7f8cd80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cd80b0270 0x7f8cd8146990 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 --2- 172.21.15.110:0/3720901980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80afdd0 0x7f8cd81693a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 >> 172.21.15.110:0/3720901980 conn(0x7f8cd8067750 msgr2=0x7f8cd8068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 shutdown_connections 2024-08-17T02:32:28.045 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.043+0000 7f8cd7e00640 1 -- 172.21.15.110:0/3720901980 wait complete. 2024-08-17T02:32:28.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:28.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.204+0000 7f672fc00640 1 Processor -- start 2024-08-17T02:32:28.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.205+0000 7f672fc00640 1 -- start start 2024-08-17T02:32:28.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f672fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 0x7f67280caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f672fc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67280caa80 con 0x7f6728140580 2024-08-17T02:32:28.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f672fc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67280c9e70 con 0x7f67280b1440 2024-08-17T02:32:28.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f672fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280cb450 con 0x7f67281401b0 2024-08-17T02:32:28.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f671fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6728140580 0x7f67280b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49838/0 (socket says 172.21.15.110:49838) 2024-08-17T02:32:28.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f671fe00640 1 -- 172.21.15.110:0/1838392482 learned_addr learned my addr 172.21.15.110:0/1838392482 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:28.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f672d200640 1 --2- 172.21.15.110:0/1838392482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 0x7f67280caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667759182 0 0) 0x7f67280caa80 con 0x7f6728140580 2024-08-17T02:32:28.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.206+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670c0034e0 con 0x7f6728140580 2024-08-17T02:32:28.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.207+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231555569 0 0) 0x7f67280c9e70 con 0x7f67280b1440 2024-08-17T02:32:28.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.207+0000 7f672d200640 1 -- 172.21.15.110:0/1838392482 >> v1:172.21.15.177:6789/0 conn(0x7f67280b1440 legacy=0x7f67280c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.207+0000 7f672d200640 1 -- 172.21.15.110:0/1838392482 >> v1:172.21.15.110:6789/0 conn(0x7f6728140580 legacy=0x7f67280b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.209 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.207+0000 7f672d200640 1 -- 172.21.15.110:0/1838392482 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280ca150 con 0x7f67281401b0 2024-08-17T02:32:28.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.208+0000 7f672d200640 1 --2- 172.21.15.110:0/1838392482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 0x7f67280caf10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6718009880 tx=0x7f67180090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785580ee89b6ab4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.208+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671802ad70 con 0x7f67281401b0 2024-08-17T02:32:28.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.208+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718032440 con 0x7f67281401b0 2024-08-17T02:32:28.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.208+0000 7f6727e00640 1 -- 172.21.15.110:0/1838392482 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180327e0 con 0x7f67281401b0 2024-08-17T02:32:28.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 -- 172.21.15.110:0/1838392482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 msgr2=0x7f67280caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 --2- 172.21.15.110:0/1838392482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 0x7f67280caf10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6718009880 tx=0x7f67180090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 -- 172.21.15.110:0/1838392482 shutdown_connections 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 --2- 172.21.15.110:0/1838392482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67281401b0 0x7f67280caf10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 -- 172.21.15.110:0/1838392482 >> 172.21.15.110:0/1838392482 conn(0x7f67280cb9b0 msgr2=0x7f67280cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 -- 172.21.15.110:0/1838392482 shutdown_connections 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.209+0000 7f672fc00640 1 -- 172.21.15.110:0/1838392482 wait complete. 2024-08-17T02:32:28.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.210+0000 7f672fc00640 1 Processor -- start 2024-08-17T02:32:28.212 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.210+0000 7f672fc00640 1 -- start start 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67281401b0 0x7f67281671c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 0x7f6728167700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6728169a20 con 0x7f67280b1440 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67280a8dd0 con 0x7f67281401b0 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280a90b0 con 0x7f6728140580 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.213 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50248/0 (socket says 172.21.15.110:50248) 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672d200640 1 -- 172.21.15.110:0/1894271551 learned_addr learned my addr 172.21.15.110:0/1894271551 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f671fe00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67281401b0 0x7f67281671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.211+0000 7f672dc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 0x7f6728167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 -- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 msgr2=0x7f6728167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 0x7f6728167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 -- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67281401b0 msgr2=0x7f67281671c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67281401b0 0x7f67281671c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 -- 172.21.15.110:0/1894271551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009390 con 0x7f67280b1440 2024-08-17T02:32:28.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672dc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 0x7f6728167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:28.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672d200640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f67180097d0 tx=0x7f6718032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6718031a60 con 0x7f67280b1440 2024-08-17T02:32:28.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6718031bc0 con 0x7f67280b1440 2024-08-17T02:32:28.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67280a9390 con 0x7f67280b1440 2024-08-17T02:32:28.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.212+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671803b400 con 0x7f67280b1440 2024-08-17T02:32:28.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.213+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67280ab1e0 con 0x7f67280b1440 2024-08-17T02:32:28.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.214+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6728064db0 con 0x7f67280b1440 2024-08-17T02:32:28.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.214+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6718043030 con 0x7f67280b1440 2024-08-17T02:32:28.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.215+0000 7f6724c00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.215+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f6718041070 con 0x7f67280b1440 2024-08-17T02:32:28.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.215+0000 7f671fe00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.216+0000 7f671fe00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 0x7f6704067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6728168340 tx=0x7f6710009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.220+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6718071250 con 0x7f67280b1440 2024-08-17T02:32:28.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.393+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6728168390 con 0x7f67280b1440 2024-08-17T02:32:28.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.394+0000 7f6724c00640 1 -- 172.21.15.110:0/1894271551 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7f6718074870 con 0x7f67280b1440 2024-08-17T02:32:28.395 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:28.395 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":41,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:32:26.207272+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/3374805694":"2024-08-18T02:32:23.197580+0000","172.21.15.110:6834/3374805694":"2024-08-18T02:32:23.197580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:28.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 msgr2=0x7f6704067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 0x7f6704067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6728168340 tx=0x7f6710009040 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 msgr2=0x7f67280aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f67180097d0 tx=0x7f6718032000 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 shutdown_connections 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6728140580 0x7f6728167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67281401b0 0x7f67281671c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 --2- 172.21.15.110:0/1894271551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67280b1440 0x7f67280aaca0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 >> 172.21.15.110:0/1894271551 conn(0x7f67280cb9b0 msgr2=0x7f672806c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 shutdown_connections 2024-08-17T02:32:28.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.396+0000 7f672fc00640 1 -- 172.21.15.110:0/1894271551 wait complete. 2024-08-17T02:32:28.413 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000013181 and related pools 2024-08-17T02:32:28.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:28.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.558+0000 7f4135600640 1 Processor -- start 2024-08-17T02:32:28.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.558+0000 7f4135600640 1 -- start start 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f4135600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 0x7f41300aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f4135600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300afc10 con 0x7f4130155180 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f4135600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300af000 con 0x7f4130155550 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f4135600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300af2e0 con 0x7f413006e790 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f412ea00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4130155180 0x7f41300ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49850/0 (socket says 172.21.15.110:49850) 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f412ea00640 1 -- 172.21.15.110:0/2622599120 learned_addr learned my addr 172.21.15.110:0/2622599120 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.560+0000 7f412f400640 1 --2- 172.21.15.110:0/2622599120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 0x7f41300aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422444584 0 0) 0x7f41300afc10 con 0x7f4130155180 2024-08-17T02:32:28.562 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41140034e0 con 0x7f4130155180 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104740247 0 0) 0x7f41300af000 con 0x7f4130155550 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41300afc10 con 0x7f4130155550 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653094031 0 0) 0x7f41140034e0 con 0x7f4130155180 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412f400640 1 -- 172.21.15.110:0/2622599120 >> v1:172.21.15.177:6789/0 conn(0x7f4130155550 legacy=0x7f413006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412f400640 1 -- 172.21.15.110:0/2622599120 >> v1:172.21.15.110:6789/0 conn(0x7f4130155180 legacy=0x7f41300ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.561+0000 7f412f400640 1 -- 172.21.15.110:0/2622599120 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300af5c0 con 0x7f413006e790 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.562+0000 7f412f400640 1 --2- 172.21.15.110:0/2622599120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 0x7f41300aea20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f412800afa0 tx=0x7f412800a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445bb0cc2dfacbaf server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.562+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120001470 con 0x7f413006e790 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.562+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412802e050 con 0x7f413006e790 2024-08-17T02:32:28.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.562+0000 7f412e000640 1 -- 172.21.15.110:0/2622599120 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800a300 con 0x7f413006e790 2024-08-17T02:32:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 -- 172.21.15.110:0/2622599120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 msgr2=0x7f41300aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 --2- 172.21.15.110:0/2622599120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 0x7f41300aea20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f412800afa0 tx=0x7f412800a890 comp rx=0 tx=0).stop 2024-08-17T02:32:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 -- 172.21.15.110:0/2622599120 shutdown_connections 2024-08-17T02:32:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 --2- 172.21.15.110:0/2622599120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413006e790 0x7f41300aea20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 -- 172.21.15.110:0/2622599120 >> 172.21.15.110:0/2622599120 conn(0x7f41300cb9b0 msgr2=0x7f41300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 -- 172.21.15.110:0/2622599120 shutdown_connections 2024-08-17T02:32:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.563+0000 7f4135600640 1 -- 172.21.15.110:0/2622599120 wait complete. 2024-08-17T02:32:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.564+0000 7f4135600640 1 Processor -- start 2024-08-17T02:32:28.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.564+0000 7f4135600640 1 -- start start 2024-08-17T02:32:28.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4130155180 0x7f4130152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4130155550 0x7f4130153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130151de0 con 0x7f413006e790 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130155b70 con 0x7f4130155550 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.565+0000 7f4135600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4130155e50 con 0x7f4130155180 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50252/0 (socket says 172.21.15.110:50252) 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 -- 172.21.15.110:0/1598483903 learned_addr learned my addr 172.21.15.110:0/1598483903 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412f400640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4130155550 0x7f4130153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f4126000640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4130155180 0x7f4130152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 -- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4130155180 msgr2=0x7f4130152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4130155180 0x7f4130152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 -- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4130155550 msgr2=0x7f4130153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4130155550 0x7f4130153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 -- 172.21.15.110:0/1598483903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412800ab30 con 0x7f413006e790 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.566+0000 7f412ea00640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f412000c960 tx=0x7f4120001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.567+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120007360 con 0x7f413006e790 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.567+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41200074e0 con 0x7f413006e790 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.567+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4130156130 con 0x7f413006e790 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.567+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200049f0 con 0x7f413006e790 2024-08-17T02:32:28.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.567+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41300c20d0 con 0x7f413006e790 2024-08-17T02:32:28.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.568+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130064db0 con 0x7f413006e790 2024-08-17T02:32:28.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.569+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f412000a640 con 0x7f413006e790 2024-08-17T02:32:28.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.569+0000 7f4126a00640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 0x7f410c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.569+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f4120081de0 con 0x7f413006e790 2024-08-17T02:32:28.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.570+0000 7f4126000640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 0x7f410c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.570+0000 7f4126000640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 0x7f410c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f413006cb00 tx=0x7f4118009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.573+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f412004fe00 con 0x7f413006e790 2024-08-17T02:32:28.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.779+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4130158c30 con 0x7f413006e790 2024-08-17T02:32:28.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.780+0000 7f4126a00640 1 -- 172.21.15.110:0/1598483903 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f4120053420 con 0x7f413006e790 2024-08-17T02:32:28.781 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:28.781 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1057905272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1057905272},{"type":"v1","addr":"172.21.15.110:6835","nonce":1057905272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:28.782 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 23 2024-08-17T02:32:28.783 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 msgr2=0x7f410c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 0x7f410c067600 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f413006cb00 tx=0x7f4118009040 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 msgr2=0x7f41300c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f412000c960 tx=0x7f4120001ba0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 shutdown_connections 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f410c065150 0x7f410c067600 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4130155550 0x7f4130153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4130155180 0x7f4130152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 --2- 172.21.15.110:0/1598483903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f413006e790 0x7f41300c1b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 >> 172.21.15.110:0/1598483903 conn(0x7f41300cb9b0 msgr2=0x7f41300ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 shutdown_connections 2024-08-17T02:32:28.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.782+0000 7f4135600640 1 -- 172.21.15.110:0/1598483903 wait complete. 2024-08-17T02:32:28.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:32:28.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.944+0000 7f0a2d800640 1 Processor -- start 2024-08-17T02:32:28.946 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.944+0000 7f0a2d800640 1 -- start start 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a2d800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0a281401b0 0x7f0a280caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a2d800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a28140580 0x7f0a280b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a2d800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a280b16d0 con 0x7f0a280b1270 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a2d800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a280cb450 con 0x7f0a28140580 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a2d800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a280caa80 con 0x7f0a281401b0 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a28140580 0x7f0a280b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0a28140580 0x7f0a280b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50264/0 (socket says 172.21.15.110:50264) 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a27400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0a280b1270 0x7f0a280c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49866/0 (socket says 172.21.15.110:49866) 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 -- 172.21.15.110:0/244685477 learned_addr learned my addr 172.21.15.110:0/244685477 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a26a00640 1 --2- 172.21.15.110:0/244685477 >> v2:172.21.15.177:3300/0 conn(0x7f0a281401b0 0x7f0a280caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 -- 172.21.15.110:0/244685477 >> v2:172.21.15.177:3300/0 conn(0x7f0a281401b0 msgr2=0x7f0a280caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 --2- 172.21.15.110:0/244685477 >> v2:172.21.15.177:3300/0 conn(0x7f0a281401b0 0x7f0a280caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a1e000640 1 -- 172.21.15.110:0/244685477 >> v1:172.21.15.110:6789/0 conn(0x7f0a280b1270 legacy=0x7f0a280c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.947+0000 7f0a1e000640 1 -- 172.21.15.110:0/244685477 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280c9e70 con 0x7f0a28140580 2024-08-17T02:32:28.949 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.946+0000 7f0a26000640 1 -- 172.21.15.110:0/244685477 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653793924 0 0) 0x7f0a20001490 con 0x7f0a280b1270 2024-08-17T02:32:28.950 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a1e000640 1 --2- 172.21.15.110:0/244685477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a280b0d30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0a28068650 tx=0x7f0a100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2ecccb5854165b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a26000640 1 -- 172.21.15.110:0/244685477 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1002adf0 con 0x7f0a28140580 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a26000640 1 -- 172.21.15.110:0/244685477 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a10032440 con 0x7f0a28140580 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a26000640 1 -- 172.21.15.110:0/244685477 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100327e0 con 0x7f0a28140580 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 -- 172.21.15.110:0/244685477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 msgr2=0x7f0a280b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 --2- 172.21.15.110:0/244685477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a280b0d30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0a28068650 tx=0x7f0a100091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 -- 172.21.15.110:0/244685477 shutdown_connections 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 --2- 172.21.15.110:0/244685477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a280b0d30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 --2- 172.21.15.110:0/244685477 >> v2:172.21.15.177:3300/0 conn(0x7f0a281401b0 0x7f0a280caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 -- 172.21.15.110:0/244685477 >> 172.21.15.110:0/244685477 conn(0x7f0a280cb9b0 msgr2=0x7f0a280cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.948+0000 7f0a2d800640 1 -- 172.21.15.110:0/244685477 shutdown_connections 2024-08-17T02:32:28.951 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.949+0000 7f0a2d800640 1 -- 172.21.15.110:0/244685477 wait complete. 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.950+0000 7f0a2d800640 1 Processor -- start 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.950+0000 7f0a2d800640 1 -- start start 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a280b1270 0x7f0a280abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a281401b0 0x7f0a2815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815c830 con 0x7f0a28140580 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815b9a0 con 0x7f0a281401b0 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a2d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815bc20 con 0x7f0a280b1270 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.954 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50276/0 (socket says 172.21.15.110:50276) 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 -- 172.21.15.110:0/4143408797 learned_addr learned my addr 172.21.15.110:0/4143408797 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a1e000640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a281401b0 0x7f0a2815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a26a00640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a280b1270 0x7f0a280abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 -- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a280b1270 msgr2=0x7f0a280abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a280b1270 0x7f0a280abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 -- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a281401b0 msgr2=0x7f0a2815b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a281401b0 0x7f0a2815b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.951+0000 7f0a27400640 1 -- 172.21.15.110:0/4143408797 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009450 con 0x7f0a28140580 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a27400640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c840 tx=0x7f0a20001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000ce30 con 0x7f0a28140580 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20005d60 con 0x7f0a28140580 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000a890 con 0x7f0a28140580 2024-08-17T02:32:28.955 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2815bf00 con 0x7f0a28140580 2024-08-17T02:32:28.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.952+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2815c4c0 con 0x7f0a28140580 2024-08-17T02:32:28.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.953+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2815c9e0 con 0x7f0a28140580 2024-08-17T02:32:28.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.954+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a2000ac80 con 0x7f0a28140580 2024-08-17T02:32:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.955+0000 7f0a1ea00640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 0x7f0a04067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.955+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f0a20081e10 con 0x7f0a28140580 2024-08-17T02:32:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.955+0000 7f0a26a00640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 0x7f0a04067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:28.957 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.956+0000 7f0a26a00640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 0x7f0a04067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009d20 tx=0x7f0a180090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:28.959 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:28.958+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a2815c9e0 con 0x7f0a28140580 2024-08-17T02:32:29.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.165+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a280b16d0 con 0x7f0a28140580 2024-08-17T02:32:29.167 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.165+0000 7f0a1ea00640 1 -- 172.21.15.110:0/4143408797 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4627 (secure 0 0 0) 0x7f0a280b16d0 con 0x7f0a28140580 2024-08-17T02:32:29.167 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:29.167 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1057905272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1057905272},{"type":"v1","addr":"172.21.15.110:6835","nonce":1057905272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:30:15.814186+0000","modified":"2024-08-17T02:30:17.806384+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4903},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4903":{"gid":4903,"name":"d","rank":0,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.177:6834/2838829509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2838829509},{"type":"v1","addr":"172.21.15.177:6834","nonce":2838829509}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000013181","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:32:29.167 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 23 2024-08-17T02:32:29.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 msgr2=0x7f0a04067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.169 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 0x7f0a04067630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009d20 tx=0x7f0a180090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 msgr2=0x7f0a281566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c840 tx=0x7f0a20001590 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 shutdown_connections 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0a04065180 0x7f0a04067630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a28140580 0x7f0a281566d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a281401b0 0x7f0a2815b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 --2- 172.21.15.110:0/4143408797 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a280b1270 0x7f0a280abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.167+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 >> 172.21.15.110:0/4143408797 conn(0x7f0a280cb9b0 msgr2=0x7f0a280cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.168+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 shutdown_connections 2024-08-17T02:32:29.170 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.168+0000 7f0a2d800640 1 -- 172.21.15.110:0/4143408797 wait complete. 2024-08-17T02:32:29.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:29.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.330+0000 7fcffcc00640 1 Processor -- start 2024-08-17T02:32:29.332 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.330+0000 7fcffcc00640 1 -- start start 2024-08-17T02:32:29.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.331+0000 7fcffcc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcff80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.331+0000 7fcffcc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcff8155df0 0x7fcff80ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.331+0000 7fcffcc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff8156670 con 0x7fcff8155a20 2024-08-17T02:32:29.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcffcc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff80b0350 con 0x7fcff8155df0 2024-08-17T02:32:29.335 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcffcc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff806e5e0 con 0x7fcff806df00 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcff8155a20 0x7fcff806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49872/0 (socket says 172.21.15.110:49872) 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5e00640 1 -- 172.21.15.110:0/2901758664 learned_addr learned my addr 172.21.15.110:0/2901758664 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcfed400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcff80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff6800640 1 --2- 172.21.15.110:0/2901758664 >> v2:172.21.15.177:3300/0 conn(0x7fcff8155df0 0x7fcff80ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249904529 0 0) 0x7fcff8156670 con 0x7fcff8155a20 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc0034e0 con 0x7fcff8155a20 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645873533 0 0) 0x7fcfdc0034e0 con 0x7fcff8155a20 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 msgr2=0x7fcff80adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcff80adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 >> v2:172.21.15.177:3300/0 conn(0x7fcff8155df0 msgr2=0x7fcff80ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:29.336 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 --2- 172.21.15.110:0/2901758664 >> v2:172.21.15.177:3300/0 conn(0x7fcff8155df0 0x7fcff80ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.332+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff806e8c0 con 0x7fcff8155a20 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fcfe80017f0 con 0x7fcff8155a20 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 >> v1:172.21.15.110:6789/0 conn(0x7fcff8155a20 legacy=0x7fcff806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcfdc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003f80 0x7fcfdc004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfdc004cc0 0x7fcfdc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff806e5e0 con 0x7fcfdc004cc0 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00b9d0 con 0x7fcfdc003f80 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfdc00bb60 con 0x7fcff806df00 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfdc004cc0 0x7fcfdc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcfed400640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003f80 0x7fcfdc004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.337 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff5e00640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcfdc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 -- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 msgr2=0x7fcfdc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:29.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff806df00 0x7fcfdc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 -- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003f80 msgr2=0x7fcfdc004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:29.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc003f80 0x7fcfdc004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.338 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.333+0000 7fcff6800640 1 -- 172.21.15.110:0/2901758664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc0034e0 con 0x7fcfdc004cc0 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.334+0000 7fcff6800640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfdc004cc0 0x7fcfdc005130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcff8156230 tx=0x7fcff00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a496a43129933f2e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0031400 con 0x7fcfdc004cc0 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff002d050 con 0x7fcfdc004cc0 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcff5400640 1 -- 172.21.15.110:0/2901758664 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0031790 con 0x7fcfdc004cc0 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 -- 172.21.15.110:0/2901758664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfdc004cc0 msgr2=0x7fcfdc005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 --2- 172.21.15.110:0/2901758664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfdc004cc0 0x7fcfdc005130 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcff8156230 tx=0x7fcff00090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcff6800640 1 -- 172.21.15.110:0/2901758664 reap_dead start 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 -- 172.21.15.110:0/2901758664 shutdown_connections 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 -- 172.21.15.110:0/2901758664 >> 172.21.15.110:0/2901758664 conn(0x7fcff80cb9b0 msgr2=0x7fcff80cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 -- 172.21.15.110:0/2901758664 shutdown_connections 2024-08-17T02:32:29.342 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.335+0000 7fcffcc00640 1 -- 172.21.15.110:0/2901758664 wait complete. 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.337+0000 7fcffcc00640 1 Processor -- start 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.337+0000 7fcffcc00640 1 -- start start 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc004cc0 0x7fcff81464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff80a8dc0 0x7fcff80a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80adec0 con 0x7fcff80ad510 2024-08-17T02:32:29.343 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80ab850 con 0x7fcfdc004cc0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcffcc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff80aac40 con 0x7fcff80a8dc0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50292/0 (socket says 172.21.15.110:50292) 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 -- 172.21.15.110:0/1477245299 learned_addr learned my addr 172.21.15.110:0/1477245299 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcff6800640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff80a8dc0 0x7fcff80a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcff5e00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc004cc0 0x7fcff81464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 -- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff80a8dc0 msgr2=0x7fcff80a9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff80a8dc0 0x7fcff80a9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 -- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc004cc0 msgr2=0x7fcff81464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc004cc0 0x7fcff81464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.338+0000 7fcfed400640 1 -- 172.21.15.110:0/1477245299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80aaf20 con 0x7fcff80ad510 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcfed400640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0011a60 tx=0x7fcfe00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.344 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000fb00 con 0x7fcff80ad510 2024-08-17T02:32:29.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000fc60 con 0x7fcff80ad510 2024-08-17T02:32:29.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0014440 con 0x7fcff80ad510 2024-08-17T02:32:29.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff80ab200 con 0x7fcff80ad510 2024-08-17T02:32:29.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.339+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff81469f0 con 0x7fcff80ad510 2024-08-17T02:32:29.345 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.340+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff80ab9c0 con 0x7fcff80ad510 2024-08-17T02:32:29.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.341+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcfe0014830 con 0x7fcff80ad510 2024-08-17T02:32:29.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.342+0000 7fcfee000640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 0x7fcfd4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.342+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fcfe0018030 con 0x7fcff80ad510 2024-08-17T02:32:29.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.342+0000 7fcff5e00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 0x7fcfd4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.346 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.343+0000 7fcff5e00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 0x7fcfd4067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8001920 tx=0x7fcfe8006040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.347 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.346+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcfe0050f80 con 0x7fcff80ad510 2024-08-17T02:32:29.523 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.522+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcff8064db0 con 0x7fcff80ad510 2024-08-17T02:32:29.524 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.523+0000 7fcfee000640 1 -- 172.21.15.110:0/1477245299 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+15562 (secure 0 0 0) 0x7fcfe0022090 con 0x7fcff80ad510 2024-08-17T02:32:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:29.525 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":41,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:32:26.207272+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000013181.meta","create_time":"2024-08-17T02:30:13.947037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000013181"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000013181.data","create_time":"2024-08-17T02:30:14.843060+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000013181"}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/3374805694":"2024-08-18T02:32:23.197580+0000","172.21.15.110:6834/3374805694":"2024-08-18T02:32:23.197580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 msgr2=0x7fcfd4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 0x7fcfd4067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8001920 tx=0x7fcfe8006040 comp rx=0 tx=0).stop 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 msgr2=0x7fcff80ad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0011a60 tx=0x7fcfe00090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 shutdown_connections 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfd4065150 0x7fcfd4067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcff80a8dc0 0x7fcff80a9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.527 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcff80ad510 0x7fcff80ad980 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 --2- 172.21.15.110:0/1477245299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfdc004cc0 0x7fcff81464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 >> 172.21.15.110:0/1477245299 conn(0x7fcff80cb9b0 msgr2=0x7fcff8158190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 shutdown_connections 2024-08-17T02:32:29.528 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.525+0000 7fcffcc00640 1 -- 172.21.15.110:0/1477245299 wait complete. 2024-08-17T02:32:29.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000013181 2024-08-17T02:32:29.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.688+0000 7f599f200640 1 Processor -- start 2024-08-17T02:32:29.689 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.688+0000 7f599f200640 1 -- start start 2024-08-17T02:32:29.690 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59a0155900 0x7f59a0155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f59a0158b30 0x7f59a00ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a0157690 con 0x7f59a00b0270 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a0156a80 con 0x7f59a0155900 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a0156d60 con 0x7f59a0158b30 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59a0155900 0x7f59a0155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59a0155900 0x7f59a0155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50294/0 (socket says 172.21.15.110:50294) 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599de00640 1 -- 172.21.15.110:0/842718839 learned_addr learned my addr 172.21.15.110:0/842718839 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:29.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.689+0000 7f599e800640 1 --2- 172.21.15.110:0/842718839 >> v2:172.21.15.177:3300/0 conn(0x7f59a0158b30 0x7f59a00ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.690+0000 7f599de00640 1 -- 172.21.15.110:0/842718839 >> v2:172.21.15.177:3300/0 conn(0x7f59a0158b30 msgr2=0x7f59a00ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.690+0000 7f599de00640 1 --2- 172.21.15.110:0/842718839 >> v2:172.21.15.177:3300/0 conn(0x7f59a0158b30 0x7f59a00ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.690+0000 7f599de00640 1 -- 172.21.15.110:0/842718839 >> v1:172.21.15.110:6789/0 conn(0x7f59a00b0270 legacy=0x7f59a0156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.690+0000 7f599de00640 1 -- 172.21.15.110:0/842718839 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0157040 con 0x7f59a0155900 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599de00640 1 --2- 172.21.15.110:0/842718839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a0155cd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59a00b06c0 tx=0x7f59900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed646949011148b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599d400640 1 -- 172.21.15.110:0/842718839 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599002ae70 con 0x7f59a0155900 2024-08-17T02:32:29.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599d400640 1 -- 172.21.15.110:0/842718839 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5990032440 con 0x7f59a0155900 2024-08-17T02:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599d400640 1 -- 172.21.15.110:0/842718839 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990032820 con 0x7f59a0155900 2024-08-17T02:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599f200640 1 -- 172.21.15.110:0/842718839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 msgr2=0x7f59a0155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.691+0000 7f599f200640 1 --2- 172.21.15.110:0/842718839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a0155cd0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f59a00b06c0 tx=0x7f59900091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 -- 172.21.15.110:0/842718839 shutdown_connections 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 --2- 172.21.15.110:0/842718839 >> v2:172.21.15.177:3300/0 conn(0x7f59a0158b30 0x7f59a00ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 --2- 172.21.15.110:0/842718839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a0155cd0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 -- 172.21.15.110:0/842718839 >> 172.21.15.110:0/842718839 conn(0x7f59a0067750 msgr2=0x7f59a00cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 -- 172.21.15.110:0/842718839 shutdown_connections 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.692+0000 7f599f200640 1 -- 172.21.15.110:0/842718839 wait complete. 2024-08-17T02:32:29.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.693+0000 7f599f200640 1 Processor -- start 2024-08-17T02:32:29.695 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.693+0000 7f599f200640 1 -- start start 2024-08-17T02:32:29.696 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b0270 0x7f59a0144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 0x7f59a016c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00aabe0 con 0x7f59a0155900 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00aaec0 con 0x7f59a0158b30 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f599f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a00ab1a0 con 0x7f59a00b0270 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f5995400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f5995400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50306/0 (socket says 172.21.15.110:50306) 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.694+0000 7f5995400640 1 -- 172.21.15.110:0/2376864990 learned_addr learned my addr 172.21.15.110:0/2376864990 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f599de00640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b0270 0x7f59a0144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f599e800640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 0x7f59a016c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.697 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 -- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b0270 msgr2=0x7f59a0144d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b0270 0x7f59a0144d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 -- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 msgr2=0x7f59a016c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 0x7f59a016c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 -- 172.21.15.110:0/2376864990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5990009450 con 0x7f59a0155900 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f599e800640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 0x7f59a016c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5995400640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f598800c560 tx=0x7f5988007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011590 con 0x7f59a0155900 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988011710 con 0x7f59a0155900 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988011ad0 con 0x7f59a0155900 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a00ab480 con 0x7f59a0155900 2024-08-17T02:32:29.698 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.695+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a0145280 con 0x7f59a0155900 2024-08-17T02:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.696+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a00ab980 con 0x7f59a0155900 2024-08-17T02:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.697+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f598801b3b0 con 0x7f59a0155900 2024-08-17T02:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.698+0000 7f5996000640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 0x7f597c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:29.699 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.698+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5988081a30 con 0x7f59a0155900 2024-08-17T02:32:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.698+0000 7f599de00640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 0x7f597c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:29.700 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.699+0000 7f599de00640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 0x7f597c067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5990034000 tx=0x7f5990032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:29.703 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.702+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f598804fa80 con 0x7f59a0155900 2024-08-17T02:32:29.911 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.910+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000013181"} v 0) v1 -- 0x7f59a0071050 con 0x7f59a0155900 2024-08-17T02:32:29.911 INFO:tasks.ceph.mon.a.smithi110.stderr:2024-08-17T02:32:29.910+0000 7f9668200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:32:29.916 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.914+0000 7f5996000640 1 -- 172.21.15.110:0/2376864990 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000013181"}]=0 volume_0000000000013181 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 195+0+0 (secure 0 0 0) 0x7f5988017070 con 0x7f59a0155900 2024-08-17T02:32:29.916 INFO:teuthology.orchestra.run.smithi110.stderr:volume_0000000000013181 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 msgr2=0x7f597c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 0x7f597c067600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5990034000 tx=0x7f5990032000 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 msgr2=0x7f59a00aa360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f598800c560 tx=0x7f5988007ef0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 shutdown_connections 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f597c065150 0x7f597c067600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a0158b30 0x7f59a016c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59a0155900 0x7f59a00aa360 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 --2- 172.21.15.110:0/2376864990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a00b0270 0x7f59a0144d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.917+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 >> 172.21.15.110:0/2376864990 conn(0x7f59a0067750 msgr2=0x7f59a0069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:29.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.918+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 shutdown_connections 2024-08-17T02:32:29.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:29.918+0000 7f599f200640 1 -- 172.21.15.110:0/2376864990 wait complete. 2024-08-17T02:32:29.923 INFO:tasks.ceph.mds.d.smithi177.stderr: -3082> 2024-08-17T02:30:22.683+0000 7fa65de00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:32:29.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000013181 --yes-i-really-mean-it 2024-08-17T02:32:29.965 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-08-17T02:32:30.083 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.082+0000 7fa0a0a00640 1 Processor -- start 2024-08-17T02:32:30.084 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.082+0000 7fa0a0a00640 1 -- start start 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa09c159b90 0x7fa09c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa09c0ca8a0 0x7fa09c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 0x7fa09c0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0cb880 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c0cd6e0 con 0x7fa09c159b90 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa0a0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0cadc0 con 0x7fa09c159f60 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa091e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa09c0ca8a0 0x7fa09c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.085 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa091e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa09c0ca8a0 0x7fa09c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50314/0 (socket says 172.21.15.110:50314) 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa091e00640 1 -- 172.21.15.110:0/1528980284 learned_addr learned my addr 172.21.15.110:0/1528980284 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa09b200640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 0x7fa09c0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.083+0000 7fa09a800640 1 --2- 172.21.15.110:0/1528980284 >> v2:172.21.15.177:3300/0 conn(0x7fa09c159b90 0x7fa09c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa091e00640 1 -- 172.21.15.110:0/1528980284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 msgr2=0x7fa09c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa091e00640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 0x7fa09c0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa091e00640 1 -- 172.21.15.110:0/1528980284 >> v2:172.21.15.177:3300/0 conn(0x7fa09c159b90 msgr2=0x7fa09c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa091e00640 1 --2- 172.21.15.110:0/1528980284 >> v2:172.21.15.177:3300/0 conn(0x7fa09c159b90 0x7fa09c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa091e00640 1 -- 172.21.15.110:0/1528980284 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0cb060 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.086 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.084+0000 7fa09b200640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 0x7fa09c0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:30.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa091e00640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0cc590 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa09c08a320 tx=0x7fa0840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9c032d2ebca87c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:30.087 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa099e00640 1 -- 172.21.15.110:0/1528980284 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08402add0 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa099e00640 1 -- 172.21.15.110:0/1528980284 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa084032440 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa099e00640 1 -- 172.21.15.110:0/1528980284 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084032820 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1528980284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c0ca8a0 msgr2=0x7fa09c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.085+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0cc590 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa09c08a320 tx=0x7fa0840091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1528980284 shutdown_connections 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159f60 0x7fa09c0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1528980284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0cc590 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1528980284 >> v2:172.21.15.177:3300/0 conn(0x7fa09c159b90 0x7fa09c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1528980284 >> 172.21.15.110:0/1528980284 conn(0x7fa09c098e00 msgr2=0x7fa09c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1528980284 shutdown_connections 2024-08-17T02:32:30.088 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.086+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1528980284 wait complete. 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.087+0000 7fa0a0a00640 1 Processor -- start 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.087+0000 7fa0a0a00640 1 -- start start 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159b90 0x7fa09c0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c6430 con 0x7fa09c159f60 2024-08-17T02:32:30.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c7db0 con 0x7fa09c0ca8a0 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa0a0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c0c71a0 con 0x7fa09c159b90 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa09b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa09a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa09b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50316/0 (socket says 172.21.15.110:50316) 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa09b200640 1 -- 172.21.15.110:0/1214660105 learned_addr learned my addr 172.21.15.110:0/1214660105 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.088+0000 7fa091e00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159b90 0x7fa09c0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 -- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159b90 msgr2=0x7fa09c0c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159b90 0x7fa09c0c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 -- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 msgr2=0x7fa09c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 -- 172.21.15.110:0/1214660105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa084009450 con 0x7fa09c159f60 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09a800640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:30.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa09b200640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d890 tx=0x7fa094008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:30.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400de20 con 0x7fa09c159f60 2024-08-17T02:32:30.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0940098b0 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094009c70 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c0c7480 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.089+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c0c7a40 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.090+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c071050 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.091+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa094012630 con 0x7fa09c159f60 2024-08-17T02:32:30.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.092+0000 7fa092a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 0x7fa078067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:30.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.092+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7fa094082800 con 0x7fa09c159f60 2024-08-17T02:32:30.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.092+0000 7fa09a800640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 0x7fa078067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:30.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.093+0000 7fa09a800640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 0x7fa078067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007a30 tx=0x7fa08c009880 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:30.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.096+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa0940507f0 con 0x7fa09c159f60 2024-08-17T02:32:30.307 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.306+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000013181", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa09c06ed30 con 0x7fa09c159f60 2024-08-17T02:32:30.917 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.916+0000 7fa092a00640 1 -- 172.21.15.110:0/1214660105 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000013181", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 121+0+0 (secure 0 0 0) 0x7fa094053e10 con 0x7fa09c159f60 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 msgr2=0x7fa078067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 0x7fa078067630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa08c007a30 tx=0x7fa08c009880 comp rx=0 tx=0).stop 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 msgr2=0x7fa09c1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa09400d890 tx=0x7fa094008040 comp rx=0 tx=0).stop 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 shutdown_connections 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa078065180 0x7fa078067630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa09c159f60 0x7fa09c1552b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa09c159b90 0x7fa09c0c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 --2- 172.21.15.110:0/1214660105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa09c0ca8a0 0x7fa09c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:30.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 >> 172.21.15.110:0/1214660105 conn(0x7fa09c098e00 msgr2=0x7fa09c0673b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:30.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 shutdown_connections 2024-08-17T02:32:30.921 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:30.918+0000 7fa0a0a00640 1 -- 172.21.15.110:0/1214660105 wait complete. 2024-08-17T02:32:30.936 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000013181.meta cephfs.volume_0000000000013181.meta --yes-i-really-really-mean-it 2024-08-17T02:32:31.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.089+0000 7f32b9800640 1 Processor -- start 2024-08-17T02:32:31.090 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.089+0000 7f32b9800640 1 -- start start 2024-08-17T02:32:31.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b9800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f32b4155470 0x7f32b406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.091 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b9800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b40ab4a0 con 0x7f32b406d7a0 2024-08-17T02:32:31.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b9800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b40aa8d0 con 0x7f32b4155470 2024-08-17T02:32:31.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b40aab70 con 0x7f32b40aea90 2024-08-17T02:32:31.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f32b406d7a0 0x7f32b4154d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49888/0 (socket says 172.21.15.110:49888) 2024-08-17T02:32:31.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32b3e00640 1 -- 172.21.15.110:0/2787711637 learned_addr learned my addr 172.21.15.110:0/2787711637 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:31.092 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.090+0000 7f32ab400640 1 --2- 172.21.15.110:0/2787711637 >> v2:172.21.15.110:3300/0 conn(0x7f32b4155470 0x7f32b406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32b3400640 1 -- 172.21.15.110:0/2787711637 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567219948 0 0) 0x7f32b40ab4a0 con 0x7f32b406d7a0 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32b8e00640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32b3400640 1 -- 172.21.15.110:0/2787711637 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32980034e0 con 0x7f32b406d7a0 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32ab400640 1 -- 172.21.15.110:0/2787711637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 msgr2=0x7f32b40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32ab400640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b40aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32ab400640 1 -- 172.21.15.110:0/2787711637 >> v1:172.21.15.110:6789/0 conn(0x7f32b406d7a0 legacy=0x7f32b4154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:31.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32ab400640 1 -- 172.21.15.110:0/2787711637 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40aae50 con 0x7f32b4155470 2024-08-17T02:32:31.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.091+0000 7f32b8e00640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:31.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32ab400640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b406db70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f329c009850 tx=0x7f329c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be60bf0489be34a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:31.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b3400640 1 -- 172.21.15.110:0/2787711637 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c02ad90 con 0x7f32b4155470 2024-08-17T02:32:31.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b3400640 1 -- 172.21.15.110:0/2787711637 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c032440 con 0x7f32b4155470 2024-08-17T02:32:31.094 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b3400640 1 -- 172.21.15.110:0/2787711637 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c032820 con 0x7f32b4155470 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 -- 172.21.15.110:0/2787711637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 msgr2=0x7f32b406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b406db70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f329c009850 tx=0x7f329c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 -- 172.21.15.110:0/2787711637 shutdown_connections 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 --2- 172.21.15.110:0/2787711637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b406db70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.092+0000 7f32b9800640 1 -- 172.21.15.110:0/2787711637 >> 172.21.15.110:0/2787711637 conn(0x7f32b4067750 msgr2=0x7f32b40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.093+0000 7f32b9800640 1 -- 172.21.15.110:0/2787711637 shutdown_connections 2024-08-17T02:32:31.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.093+0000 7f32b9800640 1 -- 172.21.15.110:0/2787711637 wait complete. 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.094+0000 7f32b9800640 1 Processor -- start 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.094+0000 7f32b9800640 1 -- start start 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b406d7a0 0x7f32b41419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b413d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4142db0 con 0x7f32b4155470 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b4141f20 con 0x7f32b406d7a0 2024-08-17T02:32:31.097 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b41421a0 con 0x7f32b40aea90 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50324/0 (socket says 172.21.15.110:50324) 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b8e00640 1 -- 172.21.15.110:0/2423642706 learned_addr learned my addr 172.21.15.110:0/2423642706 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32b3e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b406d7a0 0x7f32b41419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.095+0000 7f32ab400640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b413d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 -- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 msgr2=0x7f32b413d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b413d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 -- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b406d7a0 msgr2=0x7f32b41419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b406d7a0 0x7f32b41419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 -- 172.21.15.110:0/2423642706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c009390 con 0x7f32b4155470 2024-08-17T02:32:31.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b8e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00a380 tx=0x7f32ac007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:31.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00d650 con 0x7f32b4155470 2024-08-17T02:32:31.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac00d7b0 con 0x7f32b4155470 2024-08-17T02:32:31.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00db70 con 0x7f32b4155470 2024-08-17T02:32:31.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b4142480 con 0x7f32b4155470 2024-08-17T02:32:31.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.096+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b4142a40 con 0x7f32b4155470 2024-08-17T02:32:31.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.098+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b4142f60 con 0x7f32b4155470 2024-08-17T02:32:31.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.098+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f32ac01e3b0 con 0x7f32b4155470 2024-08-17T02:32:31.100 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.099+0000 7f32abe00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 0x7f3290067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:31.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.099+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f32ac082fd0 con 0x7f32b4155470 2024-08-17T02:32:31.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.099+0000 7f32b3e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 0x7f3290067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:31.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.100+0000 7f32b3e00640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 0x7f3290067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32a4005840 tx=0x7f32a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:31.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.103+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32b4142f60 con 0x7f32b4155470 2024-08-17T02:32:31.279 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:31.278+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000013181.meta", "pool2": "cephfs.volume_0000000000013181.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32b4142f60 con 0x7f32b4155470 2024-08-17T02:32:32.241 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.239+0000 7f32abe00640 1 -- 172.21.15.110:0/2423642706 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000013181.meta", "pool2": "cephfs.volume_0000000000013181.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000013181.meta' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f32b4142f60 con 0x7f32b4155470 2024-08-17T02:32:32.241 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs.volume_0000000000013181.meta' removed 2024-08-17T02:32:32.244 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.243+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 msgr2=0x7f3290067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.243+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 0x7f3290067600 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f32a4005840 tx=0x7f32a4009040 comp rx=0 tx=0).stop 2024-08-17T02:32:32.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.243+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 msgr2=0x7f32b41473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.243+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00a380 tx=0x7f32ac007900 comp rx=0 tx=0).stop 2024-08-17T02:32:32.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 shutdown_connections 2024-08-17T02:32:32.245 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f3290065150 0x7f3290067600 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32b4155470 0x7f32b41473c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32b40aea90 0x7f32b413d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 --2- 172.21.15.110:0/2423642706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32b406d7a0 0x7f32b41419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 >> 172.21.15.110:0/2423642706 conn(0x7f32b4067750 msgr2=0x7f32b40685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 shutdown_connections 2024-08-17T02:32:32.246 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.244+0000 7f32b9800640 1 -- 172.21.15.110:0/2423642706 wait complete. 2024-08-17T02:32:32.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000013181.data cephfs.volume_0000000000013181.data --yes-i-really-really-mean-it 2024-08-17T02:32:32.413 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.412+0000 7fa9f8400640 1 Processor -- start 2024-08-17T02:32:32.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.412+0000 7fa9f8400640 1 -- start start 2024-08-17T02:32:32.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.413+0000 7fa9f8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f0150130 0x7fa9f00aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.413+0000 7fa9f8400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa9f006e5f0 0x7fa9f00ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.413+0000 7fa9f8400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f01568b0 con 0x7fa9f0156d40 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.413+0000 7fa9f8400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f0150500 con 0x7fa9f006e5f0 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.413+0000 7fa9f8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0155fc0 con 0x7fa9f0150130 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa9f006e5f0 0x7fa9f00ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa9f006e5f0 0x7fa9f00ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50334/0 (socket says 172.21.15.110:50334) 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f5000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa9f0156d40 0x7fa9f006dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49896/0 (socket says 172.21.15.110:49896) 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 -- 172.21.15.110:0/3496155114 learned_addr learned my addr 172.21.15.110:0/3496155114 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f5a00640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f0150130 0x7fa9f00aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.416 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 -- 172.21.15.110:0/3496155114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f0150130 msgr2=0x7fa9f00aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f0150130 0x7fa9f00aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 -- 172.21.15.110:0/3496155114 >> v1:172.21.15.110:6789/0 conn(0x7fa9f0156d40 legacy=0x7fa9f006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.417 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.414+0000 7fa9f6400640 1 -- 172.21.15.110:0/3496155114 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00add60 con 0x7fa9f006e5f0 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.415+0000 7fa9f6400640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f006e5f0 0x7fa9f00ab510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d1a0 tx=0x7fa9e800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc919ebb868c8ab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.415+0000 7fa9efe00640 1 -- 172.21.15.110:0/3496155114 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e800b2e0 con 0x7fa9f006e5f0 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.415+0000 7fa9efe00640 1 -- 172.21.15.110:0/3496155114 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e800b440 con 0x7fa9f006e5f0 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.415+0000 7fa9efe00640 1 -- 172.21.15.110:0/3496155114 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8009840 con 0x7fa9f006e5f0 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 -- 172.21.15.110:0/3496155114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f006e5f0 msgr2=0x7fa9f00ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f006e5f0 0x7fa9f00ab510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d1a0 tx=0x7fa9e800ba50 comp rx=0 tx=0).stop 2024-08-17T02:32:32.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 -- 172.21.15.110:0/3496155114 shutdown_connections 2024-08-17T02:32:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f006e5f0 0x7fa9f00ab510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 --2- 172.21.15.110:0/3496155114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f0150130 0x7fa9f00aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 -- 172.21.15.110:0/3496155114 >> 172.21.15.110:0/3496155114 conn(0x7fa9f0067750 msgr2=0x7fa9f006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 -- 172.21.15.110:0/3496155114 shutdown_connections 2024-08-17T02:32:32.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.416+0000 7fa9f8400640 1 -- 172.21.15.110:0/3496155114 wait complete. 2024-08-17T02:32:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.417+0000 7fa9f8400640 1 Processor -- start 2024-08-17T02:32:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.417+0000 7fa9f8400640 1 -- start start 2024-08-17T02:32:32.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f006e5f0 0x7fa9f0169260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 0x7fa9f016a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0147e80 con 0x7fa9f0156d40 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0169b00 con 0x7fa9f0150130 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0169de0 con 0x7fa9f006e5f0 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.418+0000 7fa9f6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50346/0 (socket says 172.21.15.110:50346) 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 -- 172.21.15.110:0/720184060 learned_addr learned my addr 172.21.15.110:0/720184060 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f5000640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 0x7fa9f016a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f5a00640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f006e5f0 0x7fa9f0169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 -- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f006e5f0 msgr2=0x7fa9f0169260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f006e5f0 0x7fa9f0169260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 -- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 msgr2=0x7fa9f016a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 0x7fa9f016a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 -- 172.21.15.110:0/720184060 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e800bcf0 con 0x7fa9f0156d40 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f5000640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 0x7fa9f016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9f6400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d200 tx=0x7fa9e8039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.419+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8032e90 con 0x7fa9f0156d40 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.420+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8045460 con 0x7fa9f0156d40 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.420+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8045840 con 0x7fa9f0156d40 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.420+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f016a0c0 con 0x7fa9f0156d40 2024-08-17T02:32:32.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.420+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f01697a0 con 0x7fa9f0156d40 2024-08-17T02:32:32.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.421+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f00ac930 con 0x7fa9f0156d40 2024-08-17T02:32:32.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.421+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa9e8045c70 con 0x7fa9f0156d40 2024-08-17T02:32:32.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.423+0000 7fa9ecc00640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 0x7fa9d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:32.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.423+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5448+0+0 (secure 0 0 0) 0x7fa9e80a43d0 con 0x7fa9f0156d40 2024-08-17T02:32:32.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.423+0000 7fa9f5a00640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 0x7fa9d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:32.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.423+0000 7fa9f5a00640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 0x7fa9d0067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00c8190 tx=0x7fa9e4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:32.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.427+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9f00ac930 con 0x7fa9f0156d40 2024-08-17T02:32:32.599 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:32.598+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000013181.data", "pool2": "cephfs.volume_0000000000013181.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9f00ac930 con 0x7fa9f0156d40 2024-08-17T02:32:33.243 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.242+0000 7fa9ecc00640 1 -- 172.21.15.110:0/720184060 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000013181.data", "pool2": "cephfs.volume_0000000000013181.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000013181.data' removed v44) v1 ==== 241+0+0 (secure 0 0 0) 0x7fa9f00ac930 con 0x7fa9f0156d40 2024-08-17T02:32:33.244 INFO:teuthology.orchestra.run.smithi110.stderr:pool 'cephfs.volume_0000000000013181.data' removed 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 msgr2=0x7fa9d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 0x7fa9d0067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00c8190 tx=0x7fa9e4008040 comp rx=0 tx=0).stop 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 msgr2=0x7fa9f0154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d200 tx=0x7fa9e8039000 comp rx=0 tx=0).stop 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 shutdown_connections 2024-08-17T02:32:33.250 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fa9d0065150 0x7fa9d0067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f0156d40 0x7fa9f0154ce0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9f0150130 0x7fa9f016a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 --2- 172.21.15.110:0/720184060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9f006e5f0 0x7fa9f0169260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.248+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 >> 172.21.15.110:0/720184060 conn(0x7fa9f0067750 msgr2=0x7fa9f00ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.249+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 shutdown_connections 2024-08-17T02:32:33.251 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.249+0000 7fa9f8400640 1 -- 172.21.15.110:0/720184060 wait complete. 2024-08-17T02:32:33.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:32:33.418 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.417+0000 7f8509600640 1 Processor -- start 2024-08-17T02:32:33.419 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.417+0000 7f8509600640 1 -- start start 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.418+0000 7f8509600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8504156d60 0x7f85040ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.418+0000 7f8509600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f85040ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.418+0000 7f8509600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850415b030 con 0x7f8504156990 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.418+0000 7f8509600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85040ae130 con 0x7f8504156d60 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.418+0000 7f8509600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040cc2e0 con 0x7f85040adcf0 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8502a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8504156990 0x7f85040b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:49908/0 (socket says 172.21.15.110:49908) 2024-08-17T02:32:33.420 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8502a00640 1 -- 172.21.15.110:0/4251461328 learned_addr learned my addr 172.21.15.110:0/4251461328 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:33.422 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8503400640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f85040ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8502000640 1 --2- 172.21.15.110:0/4251461328 >> v2:172.21.15.177:3300/0 conn(0x7f8504156d60 0x7f85040ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284044730 0 0) 0x7f850415b030 con 0x7f8504156990 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84e80034e0 con 0x7f8504156990 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278119147 0 0) 0x7f84e80034e0 con 0x7f8504156990 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 msgr2=0x7f85040ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f85040ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 >> v2:172.21.15.177:3300/0 conn(0x7f8504156d60 msgr2=0x7f85040ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 --2- 172.21.15.110:0/4251461328 >> v2:172.21.15.177:3300/0 conn(0x7f8504156d60 0x7f85040ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040b1110 con 0x7f8504156990 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f84f4001470 con 0x7f8504156990 2024-08-17T02:32:33.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 >> v1:172.21.15.110:6789/0 conn(0x7f8504156990 legacy=0x7f85040b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f84e80039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f84e8004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84e8004cc0 0x7f84e8005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040ae130 con 0x7f84e8003f50 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040cc2e0 con 0x7f84e8004cc0 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.419+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e800ba00 con 0x7f85040adcf0 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f84e8004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502a00640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f84e80039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8503400640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84e8004cc0 0x7f84e8005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 -- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 msgr2=0x7f84e80039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040adcf0 0x7f84e80039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 -- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84e8004cc0 msgr2=0x7f84e8005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84e8004cc0 0x7f84e8005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.420+0000 7f8502000640 1 -- 172.21.15.110:0/4251461328 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80034e0 con 0x7f84e8003f50 2024-08-17T02:32:33.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.421+0000 7f8502000640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f84e8004780 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009b70 tx=0x7f84f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189e808ab998a416 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.421+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0031400 con 0x7f84e8003f50 2024-08-17T02:32:33.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.421+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f002d050 con 0x7f84e8003f50 2024-08-17T02:32:33.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.421+0000 7f8501600640 1 -- 172.21.15.110:0/4251461328 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0031790 con 0x7f84e8003f50 2024-08-17T02:32:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 -- 172.21.15.110:0/4251461328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 msgr2=0x7f84e8004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 --2- 172.21.15.110:0/4251461328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f84e8004780 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009b70 tx=0x7f84f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8503400640 1 -- 172.21.15.110:0/4251461328 reap_dead start 2024-08-17T02:32:33.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 -- 172.21.15.110:0/4251461328 shutdown_connections 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 -- 172.21.15.110:0/4251461328 >> 172.21.15.110:0/4251461328 conn(0x7f8504067750 msgr2=0x7f85040cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 -- 172.21.15.110:0/4251461328 shutdown_connections 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.422+0000 7f8509600640 1 -- 172.21.15.110:0/4251461328 wait complete. 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.423+0000 7f8509600640 1 Processor -- start 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 -- start start 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 0x7f8504151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85041589e0 0x7f8504158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85041593a0 con 0x7f84e8003f50 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85041693d0 con 0x7f85041589e0 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.424+0000 7f8509600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8504169670 con 0x7f85040ad580 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50362/0 (socket says 172.21.15.110:50362) 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 -- 172.21.15.110:0/2692786836 learned_addr learned my addr 172.21.15.110:0/2692786836 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8503400640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85041589e0 0x7f8504158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502000640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 0x7f8504151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 -- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 msgr2=0x7f8504151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 0x7f8504151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 -- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85041589e0 msgr2=0x7f8504158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85041589e0 0x7f8504158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 -- 172.21.15.110:0/2692786836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504169950 con 0x7f84e8003f50 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502000640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 0x7f8504151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.425+0000 7f8502a00640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f84f40073c0 tx=0x7f84f4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.426+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f4018030 con 0x7f84e8003f50 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.426+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f400fa10 con 0x7f84e8003f50 2024-08-17T02:32:33.429 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.426+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f400fdf0 con 0x7f84e8003f50 2024-08-17T02:32:33.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.426+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8504169c30 con 0x7f84e8003f50 2024-08-17T02:32:33.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.426+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504157150 con 0x7f84e8003f50 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.427+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850416a0b0 con 0x7f84e8003f50 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.428+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f84f401b070 con 0x7f84e8003f50 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.428+0000 7f84fa000640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 0x7f84e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.428+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f84f4019070 con 0x7f84e8003f50 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.429+0000 7f8502000640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 0x7f84e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.429+0000 7f8502000640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 0x7f84e4067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034000 tx=0x7f84f0035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.433+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f84f40503a0 con 0x7f84e8003f50 2024-08-17T02:32:33.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.667+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8504071050 con 0x7f84e8003f50 2024-08-17T02:32:33.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.671+0000 7f84fa000640 1 -- 172.21.15.110:0/2692786836 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84f40539c0 con 0x7f84e8003f50 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 msgr2=0x7f84e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 0x7f84e4067600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f84f0034000 tx=0x7f84f0035000 comp rx=0 tx=0).stop 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 msgr2=0x7f85040acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f84f40073c0 tx=0x7f84f4001e90 comp rx=0 tx=0).stop 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 shutdown_connections 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f84e4065150 0x7f84e4067600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.675 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85041589e0 0x7f8504158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85040ad580 0x7f8504151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 --2- 172.21.15.110:0/2692786836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84e8003f50 0x7f85040acb80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.673+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 >> 172.21.15.110:0/2692786836 conn(0x7f8504067750 msgr2=0x7f85040b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:33.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.674+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 shutdown_connections 2024-08-17T02:32:33.676 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.674+0000 7f8509600640 1 -- 172.21.15.110:0/2692786836 wait complete. 2024-08-17T02:32:33.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:32:33.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.838+0000 7fc310a00640 1 Processor -- start 2024-08-17T02:32:33.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.838+0000 7fc310a00640 1 -- start start 2024-08-17T02:32:33.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc310a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc30c06df00 0x7fc30c0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc310a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c156670 con 0x7fc30c155df0 2024-08-17T02:32:33.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc310a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30c06e5e0 con 0x7fc30c155a20 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc310a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30c0b0350 con 0x7fc30c06df00 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc309400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc30c06df00 0x7fc30c0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc309400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc30c06df00 0x7fc30c0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49888/0 (socket says 172.21.15.110:49888) 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc309400640 1 -- 172.21.15.110:0/1750026259 learned_addr learned my addr 172.21.15.110:0/1750026259 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.839+0000 7fc30a800640 1 --1- 172.21.15.110:0/1750026259 >> v1:172.21.15.110:6789/0 conn(0x7fc30c155df0 0x7fc30c156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46258/0 (socket says 172.21.15.110:46258) 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.840+0000 7fc309400640 1 -- 172.21.15.110:0/1750026259 >> v1:172.21.15.177:6789/0 conn(0x7fc30c155a20 legacy=0x7fc30c06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.840+0000 7fc309400640 1 -- 172.21.15.110:0/1750026259 >> v1:172.21.15.110:6789/0 conn(0x7fc30c155df0 legacy=0x7fc30c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.840+0000 7fc309400640 1 -- 172.21.15.110:0/1750026259 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c06e8c0 con 0x7fc30c06df00 2024-08-17T02:32:33.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.840+0000 7fc308a00640 1 -- 172.21.15.110:0/1750026259 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547576640 0 0) 0x7fc30c156670 con 0x7fc30c155df0 2024-08-17T02:32:33.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.841+0000 7fc309400640 1 --2- 172.21.15.110:0/1750026259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c06df00 0x7fc30c0adf10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800bbc0 tx=0x7fc2f800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb06d76290560f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.841+0000 7fc308a00640 1 -- 172.21.15.110:0/1750026259 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8031630 con 0x7fc30c06df00 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.841+0000 7fc308a00640 1 -- 172.21.15.110:0/1750026259 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8031790 con 0x7fc30c06df00 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.841+0000 7fc308a00640 1 -- 172.21.15.110:0/1750026259 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8031b30 con 0x7fc30c06df00 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 -- 172.21.15.110:0/1750026259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c06df00 msgr2=0x7fc30c0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 --2- 172.21.15.110:0/1750026259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c06df00 0x7fc30c0adf10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800bbc0 tx=0x7fc2f800b460 comp rx=0 tx=0).stop 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 -- 172.21.15.110:0/1750026259 shutdown_connections 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 --2- 172.21.15.110:0/1750026259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c06df00 0x7fc30c0adf10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 -- 172.21.15.110:0/1750026259 >> 172.21.15.110:0/1750026259 conn(0x7fc30c0cb9b0 msgr2=0x7fc30c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 -- 172.21.15.110:0/1750026259 shutdown_connections 2024-08-17T02:32:33.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.842+0000 7fc310a00640 1 -- 172.21.15.110:0/1750026259 wait complete. 2024-08-17T02:32:33.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.843+0000 7fc310a00640 1 Processor -- start 2024-08-17T02:32:33.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 -- start start 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc30c06df00 0x7fc30c0a8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc30c155df0 0x7fc30c0a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0a7f30 con 0x7fc30c155a20 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0a9140 con 0x7fc30c155df0 2024-08-17T02:32:33.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.844+0000 7fc310a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30c0a73f0 con 0x7fc30c06df00 2024-08-17T02:32:33.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49892/0 (socket says 172.21.15.110:49892) 2024-08-17T02:32:33.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 -- 172.21.15.110:0/1509657732 learned_addr learned my addr 172.21.15.110:0/1509657732 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:33.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc30a800640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc30c155df0 0x7fc30c0a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309e00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc30c06df00 0x7fc30c0a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 -- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc30c06df00 msgr2=0x7fc30c0a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc30c06df00 0x7fc30c0a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 -- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc30c155df0 msgr2=0x7fc30c0a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc30c155df0 0x7fc30c0a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.845+0000 7fc309400640 1 -- 172.21.15.110:0/1509657732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f800b700 con 0x7fc30c155a20 2024-08-17T02:32:33.848 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc309400640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800bbc0 tx=0x7fc2f803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f803ae90 con 0x7fc30c155a20 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8040040 con 0x7fc30c155a20 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c0a7690 con 0x7fc30c155a20 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8044640 con 0x7fc30c155a20 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.846+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30c0a7c50 con 0x7fc30c155a20 2024-08-17T02:32:33.849 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.847+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30c0a92d0 con 0x7fc30c155a20 2024-08-17T02:32:33.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.848+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc2f8044a70 con 0x7fc30c155a20 2024-08-17T02:32:33.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.848+0000 7fc301600640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:33.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.849+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc2f80a5f70 con 0x7fc30c155a20 2024-08-17T02:32:33.850 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.849+0000 7fc309e00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:33.851 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.849+0000 7fc309e00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 0x7fc2ec067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc30c150350 tx=0x7fc2fc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:33.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:33.852+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc2f80742e0 con 0x7fc30c155a20 2024-08-17T02:32:34.089 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.087+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7fc30c064db0 con 0x7fc30c155a20 2024-08-17T02:32:34.255 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.254+0000 7fc301600640 1 -- 172.21.15.110:0/1509657732 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v159) v1 ==== 135+0+0 (secure 0 0 0) 0x7fc2f8077900 con 0x7fc30c155a20 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 msgr2=0x7fc2ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 0x7fc2ec067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc30c150350 tx=0x7fc2fc009040 comp rx=0 tx=0).stop 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 msgr2=0x7fc30c13df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800bbc0 tx=0x7fc2f803a000 comp rx=0 tx=0).stop 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 shutdown_connections 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc30c155df0 0x7fc30c0a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:34.258 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc30c155a20 0x7fc30c13df60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 --2- 172.21.15.110:0/1509657732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc30c06df00 0x7fc30c0a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 >> 172.21.15.110:0/1509657732 conn(0x7fc30c0cb9b0 msgr2=0x7fc30c154120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 shutdown_connections 2024-08-17T02:32:34.259 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:34.256+0000 7fc310a00640 1 -- 172.21.15.110:0/1509657732 wait complete. 2024-08-17T02:32:34.277 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:32:34.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:32:34.279 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000013181 --yes-i-really-mean-it' 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:Ran 1 test in 174.317s 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:32:34.280 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi110 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000013181 --yes-i-really-mean-it' 2024-08-17T02:32:34.281 INFO:tasks.cephfs_test_runner: 2024-08-17T02:32:34.281 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:32:34.513 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c6019dc92cb1448fad3b71758850a011 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:32:34.515 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:32:34.523 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:32:34.553 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:32:34.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:34.553 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:32:34.591 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:32:34.591 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:32:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:34.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:32:34.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:34.688 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:32:34.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:34.964 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-08-17T02:32:35.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.240 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-08-17T02:32:35.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-08-17T02:32:35.376 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-08-17T02:32:35.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:32:35.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.380 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:32:35.419 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:32:35.419 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:32:35.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:32:35.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.523 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:32:35.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:35.763 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-08-17T02:32:36.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:36.118 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-08-17T02:32:36.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:32:36.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-08-17T02:32:36.259 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-08-17T02:32:36.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:32:36.262 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:32:36.272 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:32:36.272 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.420+0000 7f51c4400640 1 Processor -- start 2024-08-17T02:32:36.421 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.420+0000 7f51c4400640 1 -- start start 2024-08-17T02:32:36.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c4400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f51bc15d830 0x7f51bc06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c4400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 0x7f51bc166e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.423 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0b1690 con 0x7f51bc0b0610 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c4400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0b1b20 con 0x7f51bc15d830 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c4400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0ae4a0 con 0x7f51bc15e310 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c1000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f51bc0b0610 0x7f51bc15dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46262/0 (socket says 172.21.15.110:46262) 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.421+0000 7f51c1000640 1 -- 172.21.15.110:0/901903693 learned_addr learned my addr 172.21.15.110:0/901903693 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c2400640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 0x7f51bc166e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c1a00640 1 --2- 172.21.15.110:0/901903693 >> v2:172.21.15.177:3300/0 conn(0x7f51bc15d830 0x7f51bc06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51bbe00640 1 -- 172.21.15.110:0/901903693 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367649449 0 0) 0x7f51bc0b1690 con 0x7f51bc0b0610 2024-08-17T02:32:36.424 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51bbe00640 1 -- 172.21.15.110:0/901903693 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a40034e0 con 0x7f51bc0b0610 2024-08-17T02:32:36.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c1a00640 1 -- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 msgr2=0x7f51bc166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:36.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c1a00640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 0x7f51bc166e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c1a00640 1 -- 172.21.15.110:0/901903693 >> v1:172.21.15.110:6789/0 conn(0x7f51bc0b0610 legacy=0x7f51bc15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c1a00640 1 -- 172.21.15.110:0/901903693 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc15b200 con 0x7f51bc15d830 2024-08-17T02:32:36.425 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.422+0000 7f51c2400640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 0x7f51bc166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:36.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.423+0000 7f51c1a00640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15d830 0x7f51bc06e1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009850 tx=0x7f51b00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d7fda1e33aa3d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.426 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.423+0000 7f51bbe00640 1 -- 172.21.15.110:0/901903693 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b002ad90 con 0x7f51bc15d830 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.423+0000 7f51bbe00640 1 -- 172.21.15.110:0/901903693 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0032440 con 0x7f51bc15d830 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.423+0000 7f51bbe00640 1 -- 172.21.15.110:0/901903693 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0032820 con 0x7f51bc15d830 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 -- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15d830 msgr2=0x7f51bc06e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15d830 0x7f51bc06e1b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009850 tx=0x7f51b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 -- 172.21.15.110:0/901903693 shutdown_connections 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc15e310 0x7f51bc166e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 --2- 172.21.15.110:0/901903693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15d830 0x7f51bc06e1b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.427 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 -- 172.21.15.110:0/901903693 >> 172.21.15.110:0/901903693 conn(0x7f51bc0cb9b0 msgr2=0x7f51bc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:36.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 -- 172.21.15.110:0/901903693 shutdown_connections 2024-08-17T02:32:36.428 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.424+0000 7f51c4400640 1 -- 172.21.15.110:0/901903693 wait complete. 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.425+0000 7f51c4400640 1 Processor -- start 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 -- start start 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc0b0610 0x7f51bc0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15e310 0x7f51bc140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc160b40 con 0x7f51bc15d830 2024-08-17T02:32:36.430 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15ff30 con 0x7f51bc15e310 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.426+0000 7f51c4400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc160210 con 0x7f51bc0b0610 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49896/0 (socket says 172.21.15.110:49896) 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 -- 172.21.15.110:0/1452152433 learned_addr learned my addr 172.21.15.110:0/1452152433 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1a00640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc0b0610 0x7f51bc0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c2400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15e310 0x7f51bc140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.431 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 -- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc0b0610 msgr2=0x7f51bc0ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc0b0610 0x7f51bc0ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 -- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15e310 msgr2=0x7f51bc140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15e310 0x7f51bc140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 -- 172.21.15.110:0/1452152433 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009a20 con 0x7f51bc15d830 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.427+0000 7f51c1000640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c560 tx=0x7f51a8007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.428+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8005aa0 con 0x7f51bc15d830 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.428+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a8005c00 con 0x7f51bc15d830 2024-08-17T02:32:36.432 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.428+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a80070d0 con 0x7f51bc15d830 2024-08-17T02:32:36.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.428+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b0009390 con 0x7f51bc15d830 2024-08-17T02:32:36.433 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.428+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc1607d0 con 0x7f51bc15d830 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.429+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc160cb0 con 0x7f51bc15d830 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.430+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f51a8007500 con 0x7f51bc15d830 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.430+0000 7f51b8c00640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 0x7f519c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.431+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f51a8081570 con 0x7f51bc15d830 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.431+0000 7f51c1a00640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 0x7f519c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.434 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.431+0000 7f51c1a00640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 0x7f519c067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51b0034000 tx=0x7f51b0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.436 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.435+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51a804f960 con 0x7f51bc15d830 2024-08-17T02:32:36.610 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.609+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51bc064db0 con 0x7f51bc15d830 2024-08-17T02:32:36.611 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.609+0000 7f51b8c00640 1 -- 172.21.15.110:0/1452152433 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7f51a8017090 con 0x7f51bc15d830 2024-08-17T02:32:36.611 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:36.611 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":44,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:32:33.239283+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6834/2838829509":"2024-08-18T02:32:29.912111+0000","172.21.15.177:6833/2838829509":"2024-08-18T02:32:29.912111+0000","172.21.15.110:6835/3374805694":"2024-08-18T02:32:23.197580+0000","172.21.15.110:6834/3374805694":"2024-08-18T02:32:23.197580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:36.613 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.611+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 msgr2=0x7f519c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.611+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 0x7f519c067600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f51b0034000 tx=0x7f51b0032000 comp rx=0 tx=0).stop 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 msgr2=0x7f51bc15f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f51a800c560 tx=0x7f51a8007d00 comp rx=0 tx=0).stop 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 shutdown_connections 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f519c065150 0x7f519c067600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51bc15e310 0x7f51bc140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.614 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51bc15d830 0x7f51bc15f150 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 --2- 172.21.15.110:0/1452152433 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51bc0b0610 0x7f51bc0ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 >> 172.21.15.110:0/1452152433 conn(0x7f51bc0cb9b0 msgr2=0x7f51bc0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:36.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 shutdown_connections 2024-08-17T02:32:36.615 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.612+0000 7f51c4400640 1 -- 172.21.15.110:0/1452152433 wait complete. 2024-08-17T02:32:36.628 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:32:36.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:32:36.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.774+0000 7f72f4800640 1 Processor -- start 2024-08-17T02:32:36.776 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.774+0000 7f72f4800640 1 -- start start 2024-08-17T02:32:36.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.775+0000 7f72f4800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72ec1401b0 0x7f72ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.777 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.775+0000 7f72f4800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72ec0b1440 0x7f72ec0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f4800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec0caa80 con 0x7f72ec140580 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f4800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0cb450 con 0x7f72ec0b1440 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f4800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec0c9e70 con 0x7f72ec1401b0 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72ec0b1440 0x7f72ec0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72ec0b1440 0x7f72ec0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49904/0 (socket says 172.21.15.110:49904) 2024-08-17T02:32:36.778 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 -- 172.21.15.110:0/562239172 learned_addr learned my addr 172.21.15.110:0/562239172 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f1e00640 1 --2- 172.21.15.110:0/562239172 >> v2:172.21.15.177:3300/0 conn(0x7f72ec1401b0 0x7f72ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 -- 172.21.15.110:0/562239172 >> v2:172.21.15.177:3300/0 conn(0x7f72ec1401b0 msgr2=0x7f72ec0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 --2- 172.21.15.110:0/562239172 >> v2:172.21.15.177:3300/0 conn(0x7f72ec1401b0 0x7f72ec0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 -- 172.21.15.110:0/562239172 >> v1:172.21.15.177:6789/0 conn(0x7f72ec140580 legacy=0x7f72ec0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.776+0000 7f72f2800640 1 -- 172.21.15.110:0/562239172 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec0ca150 con 0x7f72ec0b1440 2024-08-17T02:32:36.780 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.777+0000 7f72f2800640 1 --2- 172.21.15.110:0/562239172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec0b1440 0x7f72ec0c9040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f72ec068650 tx=0x7f72e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35f9d46e721e2c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f0a00640 1 -- 172.21.15.110:0/562239172 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8031400 con 0x7f72ec0b1440 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f0a00640 1 -- 172.21.15.110:0/562239172 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e802d050 con 0x7f72ec0b1440 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f0a00640 1 -- 172.21.15.110:0/562239172 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80317d0 con 0x7f72ec0b1440 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 -- 172.21.15.110:0/562239172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec0b1440 msgr2=0x7f72ec0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 --2- 172.21.15.110:0/562239172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec0b1440 0x7f72ec0c9040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f72ec068650 tx=0x7f72e8009840 comp rx=0 tx=0).stop 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 -- 172.21.15.110:0/562239172 shutdown_connections 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 --2- 172.21.15.110:0/562239172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec0b1440 0x7f72ec0c9040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 --2- 172.21.15.110:0/562239172 >> v2:172.21.15.177:3300/0 conn(0x7f72ec1401b0 0x7f72ec0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 -- 172.21.15.110:0/562239172 >> 172.21.15.110:0/562239172 conn(0x7f72ec0cb9b0 msgr2=0x7f72ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:36.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 -- 172.21.15.110:0/562239172 shutdown_connections 2024-08-17T02:32:36.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.778+0000 7f72f4800640 1 -- 172.21.15.110:0/562239172 wait complete. 2024-08-17T02:32:36.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.780+0000 7f72f4800640 1 Processor -- start 2024-08-17T02:32:36.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.780+0000 7f72f4800640 1 -- start start 2024-08-17T02:32:36.784 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.780+0000 7f72f4800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ec0b1440 0x7f72ec1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.780+0000 7f72f4800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 0x7f72ec139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f4800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f4800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec1670d0 con 0x7f72ec140580 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f4800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec156600 con 0x7f72ec0b1440 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f4800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0c2dc0 con 0x7f72ec1401b0 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49910/0 (socket says 172.21.15.110:49910) 2024-08-17T02:32:36.785 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 -- 172.21.15.110:0/1952665669 learned_addr learned my addr 172.21.15.110:0/1952665669 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f1e00640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ec0b1440 0x7f72ec1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f1400640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 0x7f72ec139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 -- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 msgr2=0x7f72ec139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 0x7f72ec139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 -- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ec0b1440 msgr2=0x7f72ec1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ec0b1440 0x7f72ec1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.786 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 -- 172.21.15.110:0/1952665669 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009ae0 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f1400640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 0x7f72ec139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.781+0000 7f72f2800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72e802acd0 tx=0x7f72e8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.782+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8007170 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.782+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8008e50 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.782+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec137db0 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.782+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e803b640 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.782+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec0c3340 con 0x7f72ec140580 2024-08-17T02:32:36.787 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.783+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ec064db0 con 0x7f72ec140580 2024-08-17T02:32:36.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.784+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f72e8038050 con 0x7f72ec140580 2024-08-17T02:32:36.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.784+0000 7f72e5600640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 0x7f72d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:36.788 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.784+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f72e80a26b0 con 0x7f72ec140580 2024-08-17T02:32:36.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.785+0000 7f72f1e00640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 0x7f72d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:36.789 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.785+0000 7f72f1e00640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 0x7f72d0067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009d20 tx=0x7f72e00090f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:36.790 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.788+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f72e8070a20 con 0x7f72ec140580 2024-08-17T02:32:36.960 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.958+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72ec0c8350 con 0x7f72d0065150 2024-08-17T02:32:36.962 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.961+0000 7f72e5600640 1 -- 172.21.15.110:0/1952665669 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50888 (secure 0 0 0) 0x7f72ec0c8350 con 0x7f72d0065150 2024-08-17T02:32:36.963 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:36.963 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 msgr2=0x7f72d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 0x7f72d0067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009d20 tx=0x7f72e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 msgr2=0x7f72ec0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f72e802acd0 tx=0x7f72e8034000 comp rx=0 tx=0).stop 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 shutdown_connections 2024-08-17T02:32:36.965 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f72d0065150 0x7f72d0067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72ec140580 0x7f72ec0c3960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72ec1401b0 0x7f72ec139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 --2- 172.21.15.110:0/1952665669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72ec0b1440 0x7f72ec1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 >> 172.21.15.110:0/1952665669 conn(0x7f72ec0cb9b0 msgr2=0x7f72ec156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 shutdown_connections 2024-08-17T02:32:36.966 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:36.963+0000 7f72f4800640 1 -- 172.21.15.110:0/1952665669 wait complete. 2024-08-17T02:32:36.980 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:32:35.490159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404676,"kb_used_data":5024,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752570044,"statfs":{"total":773094113280,"available":770631725056,"internally_reserved":0,"allocated":5144576,"data_stored":2816556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001081"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:32:26.529341+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:32:26.529341+0000","last_peered":"2024-08-17T02:32:26.529341+0000","last_clean":"2024-08-17T02:32:26.529341+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:32:26.529341+0000","last_undegraded":"2024-08-17T02:32:26.529341+0000","last_fullsized":"2024-08-17T02:32:26.529341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1085440,"data_stored":794439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.627,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.45,"15min":1.45},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.81499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92300000000000004,"5min":1.014,"15min":1.014},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90300000000000002,"5min":1.151,"15min":1.151},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.54900000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88400000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.343,"15min":1.343},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.63800000000000001,"15min":0.60999999999999999},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.62,"5min":0.434,"15min":0.434},"max":{"1min":0.90800000000000003,"5min":1.371,"15min":1.371},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.621,"5min":0.503,"15min":0.503},"max":{"1min":0.90800000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.66600000000000004},"min":{"1min":0.57599999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.411,"15min":1.411},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":0.997,"15min":0.997},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.872,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":197850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89600000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80400000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":1.173,"15min":1.173},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83699999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.81799999999999995,"15min":0.86899999999999999},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.60199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.86499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91900000000000004,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92200000000000004,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.747}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.65600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.66400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90900000000000003,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.623},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":1.55,"15min":1.55},"last":0.71599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":210104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64900000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":1.024,"15min":1.024},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.62,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75900000000000001,"5min":1.099,"15min":1.099},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.044,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.64400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.248,"15min":1.248},"last":0.76700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.022,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98599999999999999,"5min":1.236,"15min":1.236},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81200000000000006},"min":{"1min":0.629,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96799999999999997,"5min":1.377,"15min":1.377},"last":0.72599999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":205555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64200000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.313},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99399999999999999,"5min":1.29,"15min":1.29},"last":0.496},{"interface":"front","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.89000000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.93799999999999994,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96299999999999997,"5min":1.319,"15min":1.319},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0329999999999999,"5min":1.143,"15min":1.143},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.012,"5min":1.389,"15min":1.389},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97899999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301996,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069844,"statfs":{"total":96636764160,"available":96327520256,"internally_reserved":0,"allocated":491520,"data_stored":204051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.442,"15min":0.45300000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.054,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.621},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95499999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.753}]},{"osd":5,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.745},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.755,"15min":0.754},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.024,"5min":1.03,"15min":1.03},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.64600000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94899999999999995,"5min":1.022,"15min":1.022},"last":0.65900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1085440,"data_stored":794383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.45200000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.432}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.54300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.64200000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65900000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.56399999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.627,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.749},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:32:36.982 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:32:37.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.129+0000 7f7091c00640 1 Processor -- start 2024-08-17T02:32:37.130 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.129+0000 7f7091c00640 1 -- start start 2024-08-17T02:32:37.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.130+0000 7f7091c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 0x7f708c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.131 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.130+0000 7f7091c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f708c0ccca0 0x7f708c162860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.130+0000 7f7091c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c0cadc0 con 0x7f708c0ca8a0 2024-08-17T02:32:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.130+0000 7f7091c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0cd6e0 con 0x7f708c0ccca0 2024-08-17T02:32:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.130+0000 7f7091c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0cb060 con 0x7f708c159ca0 2024-08-17T02:32:37.132 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 0x7f708c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708b400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f708c0ca8a0 0x7f708c0cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.110:44922/0 (socket says 172.21.15.110:44922) 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f7091200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f708c0ccca0 0x7f708c162860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708b400640 1 -- 172.21.15.110:0/2349803878 learned_addr learned my addr 172.21.15.110:0/2349803878 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708be00640 1 -- 172.21.15.110:0/2349803878 >> v2:172.21.15.177:3300/0 conn(0x7f708c0ccca0 msgr2=0x7f708c162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708be00640 1 --2- 172.21.15.110:0/2349803878 >> v2:172.21.15.177:3300/0 conn(0x7f708c0ccca0 0x7f708c162860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708be00640 1 -- 172.21.15.110:0/2349803878 >> v1:172.21.15.177:6789/0 conn(0x7f708c0ca8a0 legacy=0x7f708c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.133 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708aa00640 1 -- 172.21.15.110:0/2349803878 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243857409 0 0) 0x7f708c0cadc0 con 0x7f708c0ca8a0 2024-08-17T02:32:37.134 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.131+0000 7f708be00640 1 -- 172.21.15.110:0/2349803878 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0cb300 con 0x7f708c159ca0 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.132+0000 7f708be00640 1 --2- 172.21.15.110:0/2349803878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 0x7f708c0ca360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f707c009850 tx=0x7f707c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff55917a9862d18 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.132+0000 7f708aa00640 1 -- 172.21.15.110:0/2349803878 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c02ad90 con 0x7f708c159ca0 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.132+0000 7f708aa00640 1 -- 172.21.15.110:0/2349803878 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c032440 con 0x7f708c159ca0 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.132+0000 7f708aa00640 1 -- 172.21.15.110:0/2349803878 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c0327e0 con 0x7f708c159ca0 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 -- 172.21.15.110:0/2349803878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 msgr2=0x7f708c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.135 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 --2- 172.21.15.110:0/2349803878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 0x7f708c0ca360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f707c009850 tx=0x7f707c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 -- 172.21.15.110:0/2349803878 shutdown_connections 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 --2- 172.21.15.110:0/2349803878 >> v2:172.21.15.177:3300/0 conn(0x7f708c0ccca0 0x7f708c162860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 --2- 172.21.15.110:0/2349803878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c159ca0 0x7f708c0ca360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 -- 172.21.15.110:0/2349803878 >> 172.21.15.110:0/2349803878 conn(0x7f708c098e00 msgr2=0x7f708c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 -- 172.21.15.110:0/2349803878 shutdown_connections 2024-08-17T02:32:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.133+0000 7f7091c00640 1 -- 172.21.15.110:0/2349803878 wait complete. 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.134+0000 7f7091c00640 1 Processor -- start 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 -- start start 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 0x7f708c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c0ccca0 0x7f708c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.138 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c15c460 con 0x7f708c159ca0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0c4560 con 0x7f708c0ca8a0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.135+0000 7f7091c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c15b8e0 con 0x7f708c0ccca0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49916/0 (socket says 172.21.15.110:49916) 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 -- 172.21.15.110:0/42241021 learned_addr learned my addr 172.21.15.110:0/42241021 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f708b400640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c0ccca0 0x7f708c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f708be00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 0x7f708c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 -- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c0ccca0 msgr2=0x7f708c157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.139 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c0ccca0 0x7f708c157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 -- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 msgr2=0x7f708c0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 0x7f708c0c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f7091200640 1 -- 172.21.15.110:0/42241021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c009390 con 0x7f708c159ca0 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.136+0000 7f708be00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 0x7f708c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7091200640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7084009ec0 tx=0x7f708400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708400ce10 con 0x7f708c159ca0 2024-08-17T02:32:37.140 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708400f040 con 0x7f708c159ca0 2024-08-17T02:32:37.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840146d0 con 0x7f708c159ca0 2024-08-17T02:32:37.141 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c15bbc0 con 0x7f708c159ca0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.137+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c15c180 con 0x7f708c159ca0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.138+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c071050 con 0x7f708c159ca0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.139+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7084014a40 con 0x7f708c159ca0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.140+0000 7f7083400640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 0x7f706c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.140+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7084082f60 con 0x7f708c159ca0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.140+0000 7f708be00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 0x7f706c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.142 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.140+0000 7f708be00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 0x7f706c067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f707c034000 tx=0x7f707c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.145 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.144+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f70840512d0 con 0x7f708c159ca0 2024-08-17T02:32:37.314 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.312+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f708c0c6f50 con 0x7f706c065150 2024-08-17T02:32:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.314+0000 7f7083400640 1 -- 172.21.15.110:0/42241021 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50888 (secure 0 0 0) 0x7f708c0c6f50 con 0x7f706c065150 2024-08-17T02:32:37.316 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:32:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 msgr2=0x7f706c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 0x7f706c067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f707c034000 tx=0x7f707c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 msgr2=0x7f708c154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7084009ec0 tx=0x7f708400b040 comp rx=0 tx=0).stop 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 shutdown_connections 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f706c065150 0x7f706c067600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f708c159ca0 0x7f708c154ea0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f708c0ccca0 0x7f708c157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 --2- 172.21.15.110:0/42241021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f708c0ca8a0 0x7f708c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.316+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 >> 172.21.15.110:0/42241021 conn(0x7f708c098e00 msgr2=0x7f708c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:37.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.317+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 shutdown_connections 2024-08-17T02:32:37.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.317+0000 7f7091c00640 1 -- 172.21.15.110:0/42241021 wait complete. 2024-08-17T02:32:37.333 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-08-17T02:32:35.490159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2404676,"kb_used_data":5024,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752570044,"statfs":{"total":773094113280,"available":770631725056,"internally_reserved":0,"allocated":5144576,"data_stored":2816556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001081"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":180,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-17T02:32:26.529341+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:32:26.529341+0000","last_peered":"2024-08-17T02:32:26.529341+0000","last_clean":"2024-08-17T02:32:26.529341+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:32:26.529341+0000","last_undegraded":"2024-08-17T02:32:26.529341+0000","last_fullsized":"2024-08-17T02:32:26.529341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542188,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1085440,"data_stored":794439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.52500000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.627,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.45,"15min":1.45},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.81499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92300000000000004,"5min":1.014,"15min":1.014},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90300000000000002,"5min":1.151,"15min":1.151},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.54900000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88400000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.83299999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297840,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074000,"statfs":{"total":96636764160,"available":96331776000,"internally_reserved":0,"allocated":495616,"data_stored":204641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.343,"15min":1.343},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.63800000000000001,"15min":0.60999999999999999},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.72799999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.69799999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.62,"5min":0.434,"15min":0.434},"max":{"1min":0.90800000000000003,"5min":1.371,"15min":1.371},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.621,"5min":0.503,"15min":0.503},"max":{"1min":0.90800000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.66600000000000004},"min":{"1min":0.57599999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.411,"15min":1.411},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.78300000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":0.997,"15min":0.997},"last":0.51800000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.872,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.755},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.65000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542189,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297828,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074012,"statfs":{"total":96636764160,"available":96331788288,"internally_reserved":0,"allocated":479232,"data_stored":197850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71199999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89600000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.80000000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.92500000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80400000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82099999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":1.173,"15min":1.173},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.83699999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302004,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":499712,"data_stored":205533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.81799999999999995,"15min":0.86899999999999999},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.60199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.86499999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91900000000000004,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92200000000000004,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.78300000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.747}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.65600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.66400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90900000000000003,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.84199999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.82299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.623},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65500000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":1.55,"15min":1.55},"last":0.71599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542189,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":210104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64900000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":1.024,"15min":1.024},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.62,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75900000000000001,"5min":1.099,"15min":1.099},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.044,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.64400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.248,"15min":1.248},"last":0.76700000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.022,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98599999999999999,"5min":1.236,"15min":1.236},"last":0.80200000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81200000000000006},"min":{"1min":0.629,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96799999999999997,"5min":1.377,"15min":1.377},"last":0.72599999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302008,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069832,"statfs":{"total":96636764160,"available":96327507968,"internally_reserved":0,"allocated":503808,"data_stored":205555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64200000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51100000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.313},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.39100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.36399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99399999999999999,"5min":1.29,"15min":1.29},"last":0.496},{"interface":"front","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.89000000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55900000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.93799999999999994,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96299999999999997,"5min":1.319,"15min":1.319},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0329999999999999,"5min":1.143,"15min":1.143},"last":0.54400000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.012,"5min":1.389,"15min":1.389},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97899999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.59799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301996,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069844,"statfs":{"total":96636764160,"available":96327520256,"internally_reserved":0,"allocated":491520,"data_stored":204051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.442,"15min":0.45300000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.41899999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.56200000000000006}]},{"osd":3,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.054,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.621},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95499999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.753}]},{"osd":5,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.745},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.77100000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.755,"15min":0.754},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.024,"5min":1.03,"15min":1.03},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.70199999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.64600000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94899999999999995,"5min":1.022,"15min":1.022},"last":0.65900000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542188,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1085440,"data_stored":794383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.45200000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.432}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.54300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.64200000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65900000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.56399999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.627,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.749},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:32:37.334 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:32:37.334 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:32:37.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.480+0000 7f059b000640 1 Processor -- start 2024-08-17T02:32:37.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.480+0000 7f059b000640 1 -- start start 2024-08-17T02:32:37.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.481+0000 7f059b000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f059406df00 0x7f05940adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.481+0000 7f059b000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0594156670 con 0x7f0594155a20 2024-08-17T02:32:37.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.481+0000 7f059b000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059406e5e0 con 0x7f0594155df0 2024-08-17T02:32:37.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.481+0000 7f059b000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05940b0350 con 0x7f059406df00 2024-08-17T02:32:37.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0594155a20 0x7f059406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46276/0 (socket says 172.21.15.110:46276) 2024-08-17T02:32:37.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593e00640 1 -- 172.21.15.110:0/2946071072 learned_addr learned my addr 172.21.15.110:0/2946071072 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:37.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593400640 1 --2- 172.21.15.110:0/2946071072 >> v2:172.21.15.177:3300/0 conn(0x7f059406df00 0x7f05940adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503066200 0 0) 0x7f0594156670 con 0x7f0594155a20 2024-08-17T02:32:37.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05780034e0 con 0x7f0594155a20 2024-08-17T02:32:37.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593400640 1 -- 172.21.15.110:0/2946071072 >> v1:172.21.15.177:6789/0 conn(0x7f0594155df0 legacy=0x7f0594156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891786983 0 0) 0x7f059406e5e0 con 0x7f0594155df0 2024-08-17T02:32:37.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593400640 1 -- 172.21.15.110:0/2946071072 >> v1:172.21.15.110:6789/0 conn(0x7f0594155a20 legacy=0x7f059406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.482+0000 7f0593400640 1 -- 172.21.15.110:0/2946071072 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059406e8c0 con 0x7f059406df00 2024-08-17T02:32:37.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.483+0000 7f0593400640 1 --2- 172.21.15.110:0/2946071072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f059406df00 0x7f05940adf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0580009850 tx=0x7f05800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d82668b826707 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058002ac60 con 0x7f059406df00 2024-08-17T02:32:37.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058002adc0 con 0x7f059406df00 2024-08-17T02:32:37.486 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f0592a00640 1 -- 172.21.15.110:0/2946071072 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0580032670 con 0x7f059406df00 2024-08-17T02:32:37.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 -- 172.21.15.110:0/2946071072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f059406df00 msgr2=0x7f05940adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 --2- 172.21.15.110:0/2946071072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f059406df00 0x7f05940adf10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0580009850 tx=0x7f05800090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.487 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 -- 172.21.15.110:0/2946071072 shutdown_connections 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 --2- 172.21.15.110:0/2946071072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f059406df00 0x7f05940adf10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 -- 172.21.15.110:0/2946071072 >> 172.21.15.110:0/2946071072 conn(0x7f05940cb9b0 msgr2=0x7f05940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 -- 172.21.15.110:0/2946071072 shutdown_connections 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.484+0000 7f059b000640 1 -- 172.21.15.110:0/2946071072 wait complete. 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.486+0000 7f059b000640 1 Processor -- start 2024-08-17T02:32:37.488 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.486+0000 7f059b000640 1 -- start start 2024-08-17T02:32:37.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0594155a20 0x7f059415b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.490 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0594155df0 0x7f059415ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05941419a0 con 0x7f059406df00 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940acd70 con 0x7f0594155df0 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f059b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059415bc80 con 0x7f0594155a20 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49922/0 (socket says 172.21.15.110:49922) 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593e00640 1 -- 172.21.15.110:0/122012063 learned_addr learned my addr 172.21.15.110:0/122012063 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:37.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593400640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0594155a20 0x7f059415b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0599000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0594155df0 0x7f059415ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593e00640 1 -- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0594155a20 msgr2=0x7f059415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.487+0000 7f0593e00640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0594155a20 0x7f059415b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f0593e00640 1 -- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0594155df0 msgr2=0x7f059415ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f0593e00640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0594155df0 0x7f059415ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f0593e00640 1 -- 172.21.15.110:0/122012063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580009390 con 0x7f059406df00 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f0593e00640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f058400c7c0 tx=0x7f0584007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584007150 con 0x7f059406df00 2024-08-17T02:32:37.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05840072d0 con 0x7f059406df00 2024-08-17T02:32:37.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840047a0 con 0x7f059406df00 2024-08-17T02:32:37.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059415bf60 con 0x7f059406df00 2024-08-17T02:32:37.493 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.488+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05940aca00 con 0x7f059406df00 2024-08-17T02:32:37.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.490+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05940ac860 con 0x7f059406df00 2024-08-17T02:32:37.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.490+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0584004b50 con 0x7f059406df00 2024-08-17T02:32:37.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.491+0000 7f058b400640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 0x7f0574067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.491+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f05840815d0 con 0x7f059406df00 2024-08-17T02:32:37.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.491+0000 7f0593400640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 0x7f0574067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.492+0000 7f0593400640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 0x7f0574067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0580034000 tx=0x7f0580032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.496 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.495+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f05940ac860 con 0x7f059406df00 2024-08-17T02:32:37.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.663+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05940aceb0 con 0x7f0574065150 2024-08-17T02:32:37.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.665+0000 7f058b400640 1 -- 172.21.15.110:0/122012063 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50786 (secure 0 0 0) 0x7f0580040070 con 0x7f0574065150 2024-08-17T02:32:37.667 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:37.667 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:32:37.668 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 msgr2=0x7f0574067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 0x7f0574067600 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0580034000 tx=0x7f0580032000 comp rx=0 tx=0).stop 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 msgr2=0x7f0594141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f058400c7c0 tx=0x7f0584007d10 comp rx=0 tx=0).stop 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 shutdown_connections 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f0574065150 0x7f0574067600 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0594155df0 0x7f059415ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0594155a20 0x7f059415b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 --2- 172.21.15.110:0/122012063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f059406df00 0x7f0594141460 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 >> 172.21.15.110:0/122012063 conn(0x7f05940cb9b0 msgr2=0x7f0594152340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:37.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 shutdown_connections 2024-08-17T02:32:37.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.667+0000 7f059b000640 1 -- 172.21.15.110:0/122012063 wait complete. 2024-08-17T02:32:37.683 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:32:37.490402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404880,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569840,"statfs":{"total":773094113280,"available":770631516160,"internally_reserved":0,"allocated":5349376,"data_stored":2906752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.572985"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:32:33.210292+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:32:33.210292+0000","last_peered":"2024-08-17T02:32:33.210292+0000","last_clean":"2024-08-17T02:32:33.210292+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:32:33.210292+0000","last_undegraded":"2024-08-17T02:32:33.210292+0000","last_fullsized":"2024-08-17T02:32:33.210292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.62},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.56200000000000006}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.627,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.45,"15min":1.45},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92300000000000004,"5min":1.014,"15min":1.014},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90300000000000002,"5min":1.151,"15min":1.151},"last":0.629}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.54900000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88400000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.44}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.502}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.48699999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.343,"15min":1.343},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.63800000000000001,"15min":0.60999999999999999},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54100000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.621},{"interface":"front","average":{"1min":0.754,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.62,"5min":0.434,"15min":0.434},"max":{"1min":0.90800000000000003,"5min":1.371,"15min":1.371},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.621,"5min":0.503,"15min":0.503},"max":{"1min":0.90800000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.66600000000000004},"min":{"1min":0.57599999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.411,"15min":1.411},"last":0.499}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":0.997,"15min":0.997},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.872,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53100000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89600000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66300000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80400000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.627}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":1.173,"15min":1.173},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.81799999999999995,"15min":0.86899999999999999},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.622},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.60199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.49099999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91900000000000004,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92200000000000004,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.71299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.79300000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.65600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.66400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90900000000000003,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.76900000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.82799999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":1.55,"15min":1.55},"last":0.73099999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64900000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":1.024,"15min":1.024},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.62,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75900000000000001,"5min":1.099,"15min":1.099},"last":0.55300000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.044,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.64400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.248,"15min":1.248},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.022,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98599999999999999,"5min":1.236,"15min":1.236},"last":0.63500000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81200000000000006},"min":{"1min":0.629,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96799999999999997,"5min":1.377,"15min":1.377},"last":0.65000000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64200000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.432}]},{"osd":3,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.60999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99399999999999999,"5min":1.29,"15min":1.29},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.89000000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.62},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.93799999999999994,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96299999999999997,"5min":1.319,"15min":1.319},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0329999999999999,"5min":1.143,"15min":1.143},"last":0.69899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.012,"5min":1.389,"15min":1.389},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97899999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.73599999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.442,"15min":0.45300000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.40300000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.443}]},{"osd":4,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.054,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95499999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.745},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.755,"15min":0.754},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.024,"5min":1.03,"15min":1.03},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56699999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.64600000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94899999999999995,"5min":1.022,"15min":1.022},"last":0.55500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.45200000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.432}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.54300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.64200000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65900000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.622},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.56399999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.627,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.749},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:32:37.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:32:37.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.831+0000 7f9f88400640 1 Processor -- start 2024-08-17T02:32:37.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.831+0000 7f9f88400640 1 -- start start 2024-08-17T02:32:37.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.832+0000 7f9f88400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f800b1440 0x7f9f800caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f88400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f800caa80 con 0x7f9f80140580 2024-08-17T02:32:37.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f88400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f800c9e70 con 0x7f9f801401b0 2024-08-17T02:32:37.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f88400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f800cb450 con 0x7f9f800b1440 2024-08-17T02:32:37.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f800b1440 0x7f9f800caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f800b1440 0x7f9f800caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49926/0 (socket says 172.21.15.110:49926) 2024-08-17T02:32:37.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 -- 172.21.15.110:0/2788374639 learned_addr learned my addr 172.21.15.110:0/2788374639 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:37.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f86400640 1 --1- 172.21.15.110:0/2788374639 >> v1:172.21.15.110:6789/0 conn(0x7f9f80140580 0x7f9f800c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46280/0 (socket says 172.21.15.110:46280) 2024-08-17T02:32:37.836 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 -- 172.21.15.110:0/2788374639 >> v1:172.21.15.177:6789/0 conn(0x7f9f801401b0 legacy=0x7f9f800b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 -- 172.21.15.110:0/2788374639 >> v1:172.21.15.110:6789/0 conn(0x7f9f80140580 legacy=0x7f9f800c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.833+0000 7f9f85000640 1 -- 172.21.15.110:0/2788374639 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f800ca150 con 0x7f9f800b1440 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.834+0000 7f9f85000640 1 --2- 172.21.15.110:0/2788374639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a65d5b25dcbd27b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.834+0000 7f9f7fe00640 1 -- 172.21.15.110:0/2788374639 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c032440 con 0x7f9f800b1440 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f7fe00640 1 -- 172.21.15.110:0/2788374639 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0325a0 con 0x7f9f800b1440 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f7fe00640 1 -- 172.21.15.110:0/2788374639 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c032980 con 0x7f9f800b1440 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 -- 172.21.15.110:0/2788374639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 msgr2=0x7f9f800caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.837 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 --2- 172.21.15.110:0/2788374639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800caf10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009910 tx=0x7f9f6c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 -- 172.21.15.110:0/2788374639 shutdown_connections 2024-08-17T02:32:37.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 --2- 172.21.15.110:0/2788374639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800caf10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 -- 172.21.15.110:0/2788374639 >> 172.21.15.110:0/2788374639 conn(0x7f9f800cb9b0 msgr2=0x7f9f800cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:37.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 -- 172.21.15.110:0/2788374639 shutdown_connections 2024-08-17T02:32:37.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.835+0000 7f9f88400640 1 -- 172.21.15.110:0/2788374639 wait complete. 2024-08-17T02:32:37.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.837+0000 7f9f88400640 1 Processor -- start 2024-08-17T02:32:37.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.837+0000 7f9f88400640 1 -- start start 2024-08-17T02:32:37.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f801401b0 0x7f9f800c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80140580 0x7f9f800af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800b0650 con 0x7f9f800b1440 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800c5060 con 0x7f9f80140580 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f88400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f800c5340 con 0x7f9f801401b0 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49928/0 (socket says 172.21.15.110:49928) 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 -- 172.21.15.110:0/457021482 learned_addr learned my addr 172.21.15.110:0/457021482 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:37.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85000640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f801401b0 0x7f9f800c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f86400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80140580 0x7f9f800af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 -- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f801401b0 msgr2=0x7f9f800c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f801401b0 0x7f9f800c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 -- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80140580 msgr2=0x7f9f800af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80140580 0x7f9f800af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.838+0000 7f9f85a00640 1 -- 172.21.15.110:0/457021482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009450 con 0x7f9f800b1440 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f85a00640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c560 tx=0x7f9f74007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74011590 con 0x7f9f800b1440 2024-08-17T02:32:37.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74011710 con 0x7f9f800b1440 2024-08-17T02:32:37.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74011ad0 con 0x7f9f800b1440 2024-08-17T02:32:37.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f800c5620 con 0x7f9f800b1440 2024-08-17T02:32:37.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.839+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f800af760 con 0x7f9f800b1440 2024-08-17T02:32:37.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.840+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f80064db0 con 0x7f9f800b1440 2024-08-17T02:32:37.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.841+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9f7401b3b0 con 0x7f9f800b1440 2024-08-17T02:32:37.844 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.842+0000 7f9f7cc00640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 0x7f9f60067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:37.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.842+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9f740816a0 con 0x7f9f800b1440 2024-08-17T02:32:37.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.842+0000 7f9f85000640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 0x7f9f60067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:37.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.842+0000 7f9f85000640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 0x7f9f60067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c034000 tx=0x7f9f6c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:37.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:37.845+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9f7404fab0 con 0x7f9f800b1440 2024-08-17T02:32:38.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.019+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f800c9510 con 0x7f9f800b1440 2024-08-17T02:32:38.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.020+0000 7f9f7cc00640 1 -- 172.21.15.110:0/457021482 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+12445 (secure 0 0 0) 0x7f9f74017020 con 0x7f9f800b1440 2024-08-17T02:32:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:38.021 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":44,"fsid":"19a3b248-ccfd-4c4b-910e-9f89c1cc3c77","created":"2024-08-17T02:28:50.978644+0000","modified":"2024-08-17T02:32:33.239283+0000","last_up_change":"2024-08-17T02:29:02.110419+0000","last_in_change":"2024-08-17T02:28:53.828029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:29:03.489892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"41f73586-2f27-495d-9350-83143c2dfcaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":37096},{"type":"v1","addr":"172.21.15.110:6801","nonce":37096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":37096},{"type":"v1","addr":"172.21.15.110:6803","nonce":37096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":37096},{"type":"v1","addr":"172.21.15.110:6807","nonce":37096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":37096},{"type":"v1","addr":"172.21.15.110:6805","nonce":37096}]},"public_addr":"172.21.15.110:6801/37096","cluster_addr":"172.21.15.110:6803/37096","heartbeat_back_addr":"172.21.15.110:6807/37096","heartbeat_front_addr":"172.21.15.110:6805/37096","state":["exists","up"]},{"osd":1,"uuid":"457e617e-cd62-4a54-a4d4-b8a959f9275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":37110},{"type":"v1","addr":"172.21.15.110:6825","nonce":37110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":37110},{"type":"v1","addr":"172.21.15.110:6827","nonce":37110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":37110},{"type":"v1","addr":"172.21.15.110:6831","nonce":37110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":37110},{"type":"v1","addr":"172.21.15.110:6829","nonce":37110}]},"public_addr":"172.21.15.110:6825/37110","cluster_addr":"172.21.15.110:6827/37110","heartbeat_back_addr":"172.21.15.110:6831/37110","heartbeat_front_addr":"172.21.15.110:6829/37110","state":["exists","up"]},{"osd":2,"uuid":"a31eae37-376e-4042-ade9-befabd23d1af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":37099},{"type":"v1","addr":"172.21.15.110:6809","nonce":37099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":37099},{"type":"v1","addr":"172.21.15.110:6811","nonce":37099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":37099},{"type":"v1","addr":"172.21.15.110:6816","nonce":37099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":37099},{"type":"v1","addr":"172.21.15.110:6813","nonce":37099}]},"public_addr":"172.21.15.110:6809/37099","cluster_addr":"172.21.15.110:6811/37099","heartbeat_back_addr":"172.21.15.110:6816/37099","heartbeat_front_addr":"172.21.15.110:6813/37099","state":["exists","up"]},{"osd":3,"uuid":"75ab4ea1-8a49-47a1-82c8-f2d4cf642a40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6815","nonce":37098},{"type":"v1","addr":"172.21.15.110:6817","nonce":37098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":37098},{"type":"v1","addr":"172.21.15.110:6819","nonce":37098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":37098},{"type":"v1","addr":"172.21.15.110:6823","nonce":37098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":37098},{"type":"v1","addr":"172.21.15.110:6821","nonce":37098}]},"public_addr":"172.21.15.110:6817/37098","cluster_addr":"172.21.15.110:6819/37098","heartbeat_back_addr":"172.21.15.110:6823/37098","heartbeat_front_addr":"172.21.15.110:6821/37098","state":["exists","up"]},{"osd":4,"uuid":"6d2f7bdb-17af-42c3-879f-89a14600fed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":37516},{"type":"v1","addr":"172.21.15.177:6801","nonce":37516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":37516},{"type":"v1","addr":"172.21.15.177:6803","nonce":37516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":37516},{"type":"v1","addr":"172.21.15.177:6811","nonce":37516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6805","nonce":37516},{"type":"v1","addr":"172.21.15.177:6807","nonce":37516}]},"public_addr":"172.21.15.177:6801/37516","cluster_addr":"172.21.15.177:6803/37516","heartbeat_back_addr":"172.21.15.177:6811/37516","heartbeat_front_addr":"172.21.15.177:6807/37516","state":["exists","up"]},{"osd":5,"uuid":"1cba7f31-b97d-47b9-8c6a-1984822822bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":37515},{"type":"v1","addr":"172.21.15.177:6806","nonce":37515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":37515},{"type":"v1","addr":"172.21.15.177:6810","nonce":37515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":37515},{"type":"v1","addr":"172.21.15.177:6815","nonce":37515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":37515},{"type":"v1","addr":"172.21.15.177:6813","nonce":37515}]},"public_addr":"172.21.15.177:6806/37515","cluster_addr":"172.21.15.177:6810/37515","heartbeat_back_addr":"172.21.15.177:6815/37515","heartbeat_front_addr":"172.21.15.177:6813/37515","state":["exists","up"]},{"osd":6,"uuid":"0aaf8ffb-a370-4958-be37-ed7671be64cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":37518},{"type":"v1","addr":"172.21.15.177:6824","nonce":37518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":37518},{"type":"v1","addr":"172.21.15.177:6827","nonce":37518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":37518},{"type":"v1","addr":"172.21.15.177:6831","nonce":37518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":37518},{"type":"v1","addr":"172.21.15.177:6829","nonce":37518}]},"public_addr":"172.21.15.177:6824/37518","cluster_addr":"172.21.15.177:6827/37518","heartbeat_back_addr":"172.21.15.177:6831/37518","heartbeat_front_addr":"172.21.15.177:6829/37518","state":["exists","up"]},{"osd":7,"uuid":"70d8658b-d58a-48ee-b61c-3aeeae046556","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":37517},{"type":"v1","addr":"172.21.15.177:6817","nonce":37517}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":37517},{"type":"v1","addr":"172.21.15.177:6819","nonce":37517}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":37517},{"type":"v1","addr":"172.21.15.177:6825","nonce":37517}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":37517},{"type":"v1","addr":"172.21.15.177:6821","nonce":37517}]},"public_addr":"172.21.15.177:6817/37517","cluster_addr":"172.21.15.177:6819/37517","heartbeat_back_addr":"172.21.15.177:6825/37517","heartbeat_front_addr":"172.21.15.177:6821/37517","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.045659+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.226814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.121211+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.157647+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.431480+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.152439+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.194950+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:28:59.212975+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6834/2838829509":"2024-08-18T02:32:29.912111+0000","172.21.15.177:6833/2838829509":"2024-08-18T02:32:29.912111+0000","172.21.15.110:6835/3374805694":"2024-08-18T02:32:23.197580+0000","172.21.15.110:6834/3374805694":"2024-08-18T02:32:23.197580+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:32:38.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 msgr2=0x7f9f60067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:38.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 0x7f9f60067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c034000 tx=0x7f9f6c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:38.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 msgr2=0x7f9f800c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400c560 tx=0x7f9f74007ef0 comp rx=0 tx=0).stop 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 shutdown_connections 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9f60065150 0x7f9f60067600 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f80140580 0x7f9f800af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f801401b0 0x7f9f800c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 --2- 172.21.15.110:0/457021482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f800b1440 0x7f9f800c7240 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:38.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 >> 172.21.15.110:0/457021482 conn(0x7f9f800cb9b0 msgr2=0x7f9f8013eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:38.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 shutdown_connections 2024-08-17T02:32:38.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:38.022+0000 7f9f88400640 1 -- 172.21.15.110:0/457021482 wait complete. 2024-08-17T02:32:39.040 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:32:39.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:39.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.191+0000 7f7dd6e00640 1 Processor -- start 2024-08-17T02:32:39.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.191+0000 7f7dd6e00640 1 -- start start 2024-08-17T02:32:39.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.192+0000 7f7dd6e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7dd0156d40 0x7f7dd006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dd6e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd006e880 con 0x7f7dd006e420 2024-08-17T02:32:39.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dd6e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd01568b0 con 0x7f7dd0150130 2024-08-17T02:32:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dd6e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd0150500 con 0x7f7dd0156d40 2024-08-17T02:32:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dd4e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7dd006e420 0x7f7dd00ab510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46292/0 (socket says 172.21.15.110:46292) 2024-08-17T02:32:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dd4e00640 1 -- 172.21.15.110:0/1150006028 learned_addr learned my addr 172.21.15.110:0/1150006028 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:39.195 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dc7e00640 1 --2- 172.21.15.110:0/1150006028 >> v2:172.21.15.177:3300/0 conn(0x7f7dd0156d40 0x7f7dd006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739400576 0 0) 0x7f7dc8001490 con 0x7f7dd006e420 2024-08-17T02:32:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db40034e0 con 0x7f7dd006e420 2024-08-17T02:32:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dc7e00640 1 -- 172.21.15.110:0/1150006028 >> v1:172.21.15.177:6789/0 conn(0x7f7dd0150130 legacy=0x7f7dd00aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.197 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158177362 0 0) 0x7f7db40034e0 con 0x7f7dd006e420 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.193+0000 7f7dc7e00640 1 -- 172.21.15.110:0/1150006028 >> v1:172.21.15.110:6789/0 conn(0x7f7dd006e420 legacy=0x7f7dd00ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.194+0000 7f7dc7e00640 1 -- 172.21.15.110:0/1150006028 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0155fc0 con 0x7f7dd0156d40 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dc7e00640 1 --2- 172.21.15.110:0/1150006028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd0156d40 0x7f7dd006dee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009850 tx=0x7f7db80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf9a4bc5f78e305 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8001980 con 0x7f7dd0156d40 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db802aa50 con 0x7f7dd0156d40 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dcf400640 1 -- 172.21.15.110:0/1150006028 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db802add0 con 0x7f7dd0156d40 2024-08-17T02:32:39.198 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dd6e00640 1 -- 172.21.15.110:0/1150006028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd0156d40 msgr2=0x7f7dd006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.195+0000 7f7dd6e00640 1 --2- 172.21.15.110:0/1150006028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd0156d40 0x7f7dd006dee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009850 tx=0x7f7db80090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.196+0000 7f7dd6e00640 1 -- 172.21.15.110:0/1150006028 shutdown_connections 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.196+0000 7f7dd6e00640 1 --2- 172.21.15.110:0/1150006028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd0156d40 0x7f7dd006dee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.196+0000 7f7dd6e00640 1 -- 172.21.15.110:0/1150006028 >> 172.21.15.110:0/1150006028 conn(0x7f7dd0067750 msgr2=0x7f7dd006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.196+0000 7f7dd6e00640 1 -- 172.21.15.110:0/1150006028 shutdown_connections 2024-08-17T02:32:39.199 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.196+0000 7f7dd6e00640 1 -- 172.21.15.110:0/1150006028 wait complete. 2024-08-17T02:32:39.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.197+0000 7f7dd6e00640 1 Processor -- start 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.197+0000 7f7dd6e00640 1 -- start start 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd006e420 0x7f7dd013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 0x7f7dd013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dd0156d40 0x7f7dd01508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00ca0c0 con 0x7f7dd0150130 2024-08-17T02:32:39.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00c94b0 con 0x7f7dd006e420 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd6e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00c9790 con 0x7f7dd0156d40 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 0x7f7dd013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dc7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 0x7f7dd013e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49940/0 (socket says 172.21.15.110:49940) 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dc7e00640 1 -- 172.21.15.110:0/3773380424 learned_addr learned my addr 172.21.15.110:0/3773380424 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dcfe00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd006e420 0x7f7dd013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.198+0000 7f7dd4e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dd0156d40 0x7f7dd01508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 -- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dd0156d40 msgr2=0x7f7dd01508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7dd0156d40 0x7f7dd01508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 -- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd006e420 msgr2=0x7f7dd013dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd006e420 0x7f7dd013dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db8009390 con 0x7f7dd0150130 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dcfe00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7dd006e420 0x7f7dd013dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 0x7f7dd013e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009360 tx=0x7f7db8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db803d420 con 0x7f7dd0150130 2024-08-17T02:32:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db803d580 con 0x7f7dd0150130 2024-08-17T02:32:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd00c9a70 con 0x7f7dd0150130 2024-08-17T02:32:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db803d920 con 0x7f7dd0150130 2024-08-17T02:32:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.199+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd013e7e0 con 0x7f7dd0150130 2024-08-17T02:32:39.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.200+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7dd00710c0 con 0x7f7dd0150130 2024-08-17T02:32:39.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.201+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7db803dd10 con 0x7f7dd0150130 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dc7400640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7dac065180 0x7f7dac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7db80a2fa0 con 0x7f7dd0150130 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dcfe00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7dac065180 0x7f7dac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dc7400640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7f7dac06b070 0x7f7dac06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7dac06db30 con 0x7f7dac06b070 2024-08-17T02:32:39.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7db80a3290 con 0x7f7dd0150130 2024-08-17T02:32:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.202+0000 7f7dd4e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7f7dac06b070 0x7f7dac06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.203+0000 7f7dcfe00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7dac065180 0x7f7dac067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dd016bef0 tx=0x7f7dc0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.203+0000 7f7dd4e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7f7dac06b070 0x7f7dac06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.208 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.204+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== osd.0 v2:172.21.15.110:6800/37096 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7dac06db30 con 0x7f7dac06b070 2024-08-17T02:32:39.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.216+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 --> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7dd0150e10 con 0x7f7dac06b070 2024-08-17T02:32:39.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dc7400640 1 -- 172.21.15.110:0/3773380424 <== osd.0 v2:172.21.15.110:6800/37096 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7dd0150e10 con 0x7f7dac06b070 2024-08-17T02:32:39.218 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:39.219 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:39.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7f7dac06b070 msgr2=0x7f7dac06d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6800/37096,v1:172.21.15.110:6801/37096] conn(0x7f7dac06b070 0x7f7dac06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7dac065180 msgr2=0x7f7dac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.220 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f7dac065180 0x7f7dac067630 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dd016bef0 tx=0x7f7dc0009040 comp rx=0 tx=0).stop 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 msgr2=0x7f7dd013e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 --2- 172.21.15.110:0/3773380424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0150130 0x7f7dd013e2a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009360 tx=0x7f7db8032000 comp rx=0 tx=0).stop 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd4e00640 1 -- 172.21.15.110:0/3773380424 reap_dead start 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 shutdown_connections 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 >> 172.21.15.110:0/3773380424 conn(0x7f7dd0067750 msgr2=0x7f7dd006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 shutdown_connections 2024-08-17T02:32:39.221 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.217+0000 7f7dd6e00640 1 -- 172.21.15.110:0/3773380424 wait complete. 2024-08-17T02:32:39.233 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:32:39.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.380+0000 7f9962e00640 1 Processor -- start 2024-08-17T02:32:39.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.380+0000 7f9962e00640 1 -- start start 2024-08-17T02:32:39.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c159ca0 0x7f995c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f995c0ca8a0 0x7f995c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c0ccad0 0x7f995c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0cd6e0 con 0x7f995c159ca0 2024-08-17T02:32:39.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995c0ccf70 con 0x7f995c0ca8a0 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0cadc0 con 0x7f995c0ccad0 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9961a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c159ca0 0x7f995c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9961a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f995c159ca0 0x7f995c0ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49954/0 (socket says 172.21.15.110:49954) 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9961a00640 1 -- 172.21.15.110:0/2614836565 learned_addr learned my addr 172.21.15.110:0/2614836565 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9961000640 1 --2- 172.21.15.110:0/2614836565 >> v2:172.21.15.177:3300/0 conn(0x7f995c0ca8a0 0x7f995c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.381+0000 7f9962400640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c0ccad0 0x7f995c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.382+0000 7f9961a00640 1 -- 172.21.15.110:0/2614836565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c0ccad0 msgr2=0x7f995c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:39.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.382+0000 7f9961a00640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c0ccad0 0x7f995c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.382+0000 7f9961a00640 1 -- 172.21.15.110:0/2614836565 >> v2:172.21.15.177:3300/0 conn(0x7f995c0ca8a0 msgr2=0x7f995c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:39.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.382+0000 7f9961a00640 1 --2- 172.21.15.110:0/2614836565 >> v2:172.21.15.177:3300/0 conn(0x7f995c0ca8a0 0x7f995c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.382+0000 7f9961a00640 1 -- 172.21.15.110:0/2614836565 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0cb060 con 0x7f995c159ca0 2024-08-17T02:32:39.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f9961a00640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c159ca0 0x7f995c0ca360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f995c08a060 tx=0x7f99500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b7908e180c3e26 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f995be00640 1 -- 172.21.15.110:0/2614836565 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995002add0 con 0x7f995c159ca0 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f995be00640 1 -- 172.21.15.110:0/2614836565 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950032440 con 0x7f995c159ca0 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f995be00640 1 -- 172.21.15.110:0/2614836565 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950032820 con 0x7f995c159ca0 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f9962e00640 1 -- 172.21.15.110:0/2614836565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c159ca0 msgr2=0x7f995c0ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f9962e00640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c159ca0 0x7f995c0ca360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f995c08a060 tx=0x7f99500091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.383+0000 7f9962e00640 1 -- 172.21.15.110:0/2614836565 shutdown_connections 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c0ccad0 0x7f995c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 --2- 172.21.15.110:0/2614836565 >> v2:172.21.15.177:3300/0 conn(0x7f995c0ca8a0 0x7f995c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 --2- 172.21.15.110:0/2614836565 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c159ca0 0x7f995c0ca360 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 -- 172.21.15.110:0/2614836565 >> 172.21.15.110:0/2614836565 conn(0x7f995c098e00 msgr2=0x7f995c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 -- 172.21.15.110:0/2614836565 shutdown_connections 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.384+0000 7f9962e00640 1 -- 172.21.15.110:0/2614836565 wait complete. 2024-08-17T02:32:39.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.385+0000 7f9962e00640 1 Processor -- start 2024-08-17T02:32:39.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.385+0000 7f9962e00640 1 -- start start 2024-08-17T02:32:39.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0ccad0 0x7f995c155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c159ca0 0x7f995c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c6450 con 0x7f995c0ca8a0 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c5fc0 con 0x7f995c0ccad0 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995c0c53b0 con 0x7f995c159ca0 2024-08-17T02:32:39.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9961a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9961a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49968/0 (socket says 172.21.15.110:49968) 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9961a00640 1 -- 172.21.15.110:0/1348889729 learned_addr learned my addr 172.21.15.110:0/1348889729 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9962400640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c159ca0 0x7f995c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.386+0000 7f9961000640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0ccad0 0x7f995c155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 -- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c159ca0 msgr2=0x7f995c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c159ca0 0x7f995c0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 -- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0ccad0 msgr2=0x7f995c155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0ccad0 0x7f995c155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 -- 172.21.15.110:0/1348889729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950009450 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9961a00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9950009210 tx=0x7f9950032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9950031de0 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9950000c40 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f995c0c5690 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995003d670 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.387+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995c0c5c50 con 0x7f995c0ca8a0 2024-08-17T02:32:39.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.388+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f995c071050 con 0x7f995c0ca8a0 2024-08-17T02:32:39.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.389+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9950039040 con 0x7f995c0ca8a0 2024-08-17T02:32:39.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.390+0000 7f9958c00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 0x7f993c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.390+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f99500a2410 con 0x7f995c0ca8a0 2024-08-17T02:32:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.390+0000 7f9961000640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 0x7f993c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.391+0000 7f9961000640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 0x7f993c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f995c0cf590 tx=0x7f9948008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.394+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9950070840 con 0x7f995c0ca8a0 2024-08-17T02:32:39.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.565+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f995c0c6100 con 0x7f993c065150 2024-08-17T02:32:39.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.566+0000 7f9958c00640 1 -- 172.21.15.110:0/1348889729 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9948010d50 con 0x7f993c065150 2024-08-17T02:32:39.568 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 msgr2=0x7f993c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 0x7f993c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f995c0cf590 tx=0x7f9948008040 comp rx=0 tx=0).stop 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 msgr2=0x7f995c09ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9950009210 tx=0x7f9950032000 comp rx=0 tx=0).stop 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 shutdown_connections 2024-08-17T02:32:39.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f993c065150 0x7f993c067600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995c159ca0 0x7f995c0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995c0ccad0 0x7f995c155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 --2- 172.21.15.110:0/1348889729 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f995c0ca8a0 0x7f995c09ccd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 >> 172.21.15.110:0/1348889729 conn(0x7f995c098e00 msgr2=0x7f995c159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 shutdown_connections 2024-08-17T02:32:39.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.568+0000 7f9962e00640 1 -- 172.21.15.110:0/1348889729 wait complete. 2024-08-17T02:32:39.586 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:32:39.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:39.737 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.736+0000 7fcf5f400640 1 Processor -- start 2024-08-17T02:32:39.738 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.736+0000 7fcf5f400640 1 -- start start 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580aa810 0x7fcf580aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf580af7c0 0x7fcf58068790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5f400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf580ac4e0 con 0x7fcf580ab120 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5f400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580ac780 con 0x7fcf580aa810 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5f400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580aca60 con 0x7fcf580af7c0 2024-08-17T02:32:39.739 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580aa810 0x7fcf580aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.737+0000 7fcf5ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf580aa810 0x7fcf580aabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49980/0 (socket says 172.21.15.110:49980) 2024-08-17T02:32:39.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5ca00640 1 -- 172.21.15.110:0/610639009 learned_addr learned my addr 172.21.15.110:0/610639009 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5d400640 1 --2- 172.21.15.110:0/610639009 >> v2:172.21.15.177:3300/0 conn(0x7fcf580af7c0 0x7fcf58068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5ca00640 1 -- 172.21.15.110:0/610639009 >> v2:172.21.15.177:3300/0 conn(0x7fcf580af7c0 msgr2=0x7fcf58068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:39.741 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5ca00640 1 --2- 172.21.15.110:0/610639009 >> v2:172.21.15.177:3300/0 conn(0x7fcf580af7c0 0x7fcf58068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5ca00640 1 -- 172.21.15.110:0/610639009 >> v1:172.21.15.177:6789/0 conn(0x7fcf580ab120 legacy=0x7fcf58068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.738+0000 7fcf5ca00640 1 -- 172.21.15.110:0/610639009 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580acd40 con 0x7fcf580aa810 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.739+0000 7fcf5ca00640 1 --2- 172.21.15.110:0/610639009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf580aabe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf5806cbb0 tx=0x7fcf4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0f0433157ffe09 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.739+0000 7fcf57400640 1 -- 172.21.15.110:0/610639009 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c02ae80 con 0x7fcf580aa810 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.739+0000 7fcf57400640 1 -- 172.21.15.110:0/610639009 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c032440 con 0x7fcf580aa810 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.739+0000 7fcf57400640 1 -- 172.21.15.110:0/610639009 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c032800 con 0x7fcf580aa810 2024-08-17T02:32:39.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 -- 172.21.15.110:0/610639009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 msgr2=0x7fcf580aabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 --2- 172.21.15.110:0/610639009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf580aabe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcf5806cbb0 tx=0x7fcf4c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 -- 172.21.15.110:0/610639009 shutdown_connections 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 --2- 172.21.15.110:0/610639009 >> v2:172.21.15.177:3300/0 conn(0x7fcf580af7c0 0x7fcf58068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 --2- 172.21.15.110:0/610639009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf580aabe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 -- 172.21.15.110:0/610639009 >> 172.21.15.110:0/610639009 conn(0x7fcf58096a70 msgr2=0x7fcf58096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 -- 172.21.15.110:0/610639009 shutdown_connections 2024-08-17T02:32:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.740+0000 7fcf5f400640 1 -- 172.21.15.110:0/610639009 wait complete. 2024-08-17T02:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.741+0000 7fcf5f400640 1 Processor -- start 2024-08-17T02:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.741+0000 7fcf5f400640 1 -- start start 2024-08-17T02:32:39.745 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf58068080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf580ab120 0x7fcf5814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf580af7c0 0x7fcf580b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b14c0 con 0x7fcf580aa810 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b1710 con 0x7fcf580ab120 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.742+0000 7fcf5f400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b19f0 con 0x7fcf580af7c0 2024-08-17T02:32:39.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf58068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf58068080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:49994/0 (socket says 172.21.15.110:49994) 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 -- 172.21.15.110:0/681679197 learned_addr learned my addr 172.21.15.110:0/681679197 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5d400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf580af7c0 0x7fcf580b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf57e00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf580ab120 0x7fcf5814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 -- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf580af7c0 msgr2=0x7fcf580b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf580af7c0 0x7fcf580b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 -- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf580ab120 msgr2=0x7fcf5814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf580ab120 0x7fcf5814dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009450 con 0x7fcf580aa810 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf5ca00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf58068080 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009210 tx=0x7fcf4c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.743+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c031bb0 con 0x7fcf580aa810 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.744+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c031d30 con 0x7fcf580aa810 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.744+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5815dfa0 con 0x7fcf580aa810 2024-08-17T02:32:39.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.744+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c03d670 con 0x7fcf580aa810 2024-08-17T02:32:39.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.744+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf580b1cd0 con 0x7fcf580aa810 2024-08-17T02:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.745+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf580710c0 con 0x7fcf580aa810 2024-08-17T02:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.745+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcf4c039040 con 0x7fcf580aa810 2024-08-17T02:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf4be00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcf38065150 0x7fcf38067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcf4c0a2330 con 0x7fcf580aa810 2024-08-17T02:32:39.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf57e00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcf38065150 0x7fcf38067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf4be00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7fcf3806b040 0x7fcf3806d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf3806db00 con 0x7fcf3806b040 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.746+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf4c0a4890 con 0x7fcf580aa810 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.747+0000 7fcf5d400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7fcf3806b040 0x7fcf3806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.747+0000 7fcf57e00640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcf38065150 0x7fcf38067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5816a2e0 tx=0x7fcf44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.747+0000 7fcf5d400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7fcf3806b040 0x7fcf3806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.751 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.748+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== osd.1 v2:172.21.15.110:6824/37110 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcf3806db00 con 0x7fcf3806b040 2024-08-17T02:32:39.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.760+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 --> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf5809b970 con 0x7fcf3806b040 2024-08-17T02:32:39.762 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf4be00640 1 -- 172.21.15.110:0/681679197 <== osd.1 v2:172.21.15.110:6824/37110 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcf5809b970 con 0x7fcf3806b040 2024-08-17T02:32:39.762 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:39.763 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7fcf3806b040 msgr2=0x7fcf3806d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6824/37110,v1:172.21.15.110:6825/37110] conn(0x7fcf3806b040 0x7fcf3806d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcf38065150 msgr2=0x7fcf38067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcf38065150 0x7fcf38067600 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcf5816a2e0 tx=0x7fcf44009040 comp rx=0 tx=0).stop 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 msgr2=0x7fcf58068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 --2- 172.21.15.110:0/681679197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf580aa810 0x7fcf58068080 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009210 tx=0x7fcf4c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5d400640 1 -- 172.21.15.110:0/681679197 reap_dead start 2024-08-17T02:32:39.764 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 shutdown_connections 2024-08-17T02:32:39.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.761+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 >> 172.21.15.110:0/681679197 conn(0x7fcf58096a70 msgr2=0x7fcf5806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.762+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 shutdown_connections 2024-08-17T02:32:39.765 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.762+0000 7fcf5f400640 1 -- 172.21.15.110:0/681679197 wait complete. 2024-08-17T02:32:39.776 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:32:39.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.923+0000 7f255c600640 1 Processor -- start 2024-08-17T02:32:39.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.923+0000 7f255c600640 1 -- start start 2024-08-17T02:32:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.924+0000 7f255c600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2554155180 0x7f25540aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.924+0000 7f255c600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f255406e080 0x7f255406e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.924+0000 7f255c600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540afc10 con 0x7f2554155550 2024-08-17T02:32:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.924+0000 7f255c600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255406ea00 con 0x7f2554155180 2024-08-17T02:32:39.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.924+0000 7f255c600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540af000 con 0x7f255406e080 2024-08-17T02:32:39.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559200640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2554155550 0x7f25540ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46304/0 (socket says 172.21.15.110:46304) 2024-08-17T02:32:39.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559200640 1 -- 172.21.15.110:0/3882560196 learned_addr learned my addr 172.21.15.110:0/3882560196 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:39.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559c00640 1 --2- 172.21.15.110:0/3882560196 >> v2:172.21.15.177:3300/0 conn(0x7f2554155180 0x7f25540aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f255a600640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f255406e080 0x7f255406e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69095498 0 0) 0x7f25540afc10 con 0x7f2554155550 2024-08-17T02:32:39.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f253c0034e0 con 0x7f2554155550 2024-08-17T02:32:39.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559c00640 1 -- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f255406e080 msgr2=0x7f255406e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559c00640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f255406e080 0x7f255406e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075080326 0 0) 0x7f253c0034e0 con 0x7f2554155550 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559c00640 1 -- 172.21.15.110:0/3882560196 >> v1:172.21.15.110:6789/0 conn(0x7f2554155550 legacy=0x7f25540ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.925+0000 7f2559c00640 1 -- 172.21.15.110:0/3882560196 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540af2e0 con 0x7f2554155180 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.927+0000 7f2559c00640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f25540aea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f25480090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=904855ddb8db8a11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.927+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2540001490 con 0x7f2554155180 2024-08-17T02:32:39.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.927+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254802aa50 con 0x7f2554155180 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.927+0000 7f2553e00640 1 -- 172.21.15.110:0/3882560196 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254802adf0 con 0x7f2554155180 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 -- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 msgr2=0x7f25540aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f25540aea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f25480090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 -- 172.21.15.110:0/3882560196 shutdown_connections 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f255406e080 0x7f255406e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 --2- 172.21.15.110:0/3882560196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f25540aea20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 -- 172.21.15.110:0/3882560196 >> 172.21.15.110:0/3882560196 conn(0x7f25540cb9b0 msgr2=0x7f25540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:39.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 -- 172.21.15.110:0/3882560196 shutdown_connections 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.928+0000 7f255c600640 1 -- 172.21.15.110:0/3882560196 wait complete. 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.929+0000 7f255c600640 1 Processor -- start 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.929+0000 7f255c600640 1 -- start start 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f255416cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2554155550 0x7f2554146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554156ba0 con 0x7f255406e080 2024-08-17T02:32:39.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25541587d0 con 0x7f2554155180 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f255c600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2554156270 con 0x7f2554155550 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f2559c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f2559c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50010/0 (socket says 172.21.15.110:50010) 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.930+0000 7f2559c00640 1 -- 172.21.15.110:0/706480702 learned_addr learned my addr 172.21.15.110:0/706480702 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559200640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f255416cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f255a600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2554155550 0x7f2554146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 -- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2554155550 msgr2=0x7f2554146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2554155550 0x7f2554146a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 -- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 msgr2=0x7f255416cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f255416cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 -- 172.21.15.110:0/706480702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548009390 con 0x7f255406e080 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2559c00640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f2548032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548032e60 con 0x7f255406e080 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254803d420 con 0x7f255406e080 2024-08-17T02:32:39.938 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554156550 con 0x7f255406e080 2024-08-17T02:32:39.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254803d7e0 con 0x7f255406e080 2024-08-17T02:32:39.939 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.931+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540ca320 con 0x7f255406e080 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.932+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2554064db0 con 0x7f255406e080 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.933+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2548039040 con 0x7f255406e080 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.934+0000 7f2550c00640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 0x7f2534067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.934+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f25480a1a70 con 0x7f255406e080 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.934+0000 7f2559200640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 0x7f2534067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:39.940 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.935+0000 7f2559200640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 0x7f2534067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2554156180 tx=0x7f2540001540 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:39.941 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:39.938+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f254806fd30 con 0x7f255406e080 2024-08-17T02:32:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.110+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2554156ce0 con 0x7f2534065150 2024-08-17T02:32:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.111+0000 7f2550c00640 1 -- 172.21.15.110:0/706480702 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25400058d0 con 0x7f2534065150 2024-08-17T02:32:40.112 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 msgr2=0x7f2534067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 0x7f2534067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2554156180 tx=0x7f2540001540 comp rx=0 tx=0).stop 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 msgr2=0x7f255416c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f2548032000 comp rx=0 tx=0).stop 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 shutdown_connections 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2534065150 0x7f2534067600 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2554155550 0x7f2554146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2554155180 0x7f255416cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 --2- 172.21.15.110:0/706480702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f255406e080 0x7f255416c960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 >> 172.21.15.110:0/706480702 conn(0x7f25540cb9b0 msgr2=0x7f2554152860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 shutdown_connections 2024-08-17T02:32:40.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.113+0000 7f255c600640 1 -- 172.21.15.110:0/706480702 wait complete. 2024-08-17T02:32:40.130 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:32:40.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:40.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.280+0000 7f573ac00640 1 Processor -- start 2024-08-17T02:32:40.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.280+0000 7f573ac00640 1 -- start start 2024-08-17T02:32:40.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f573ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 0x7f573406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f573ac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57340ae9b0 con 0x7f57340c8840 2024-08-17T02:32:40.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f573ac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57340ab320 con 0x7f5734156c60 2024-08-17T02:32:40.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f573ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57340aa730 con 0x7f5734156890 2024-08-17T02:32:40.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f5738c00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f57340c8840 0x7f57340ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46308/0 (socket says 172.21.15.110:46308) 2024-08-17T02:32:40.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.281+0000 7f5738c00640 1 -- 172.21.15.110:0/1864517071 learned_addr learned my addr 172.21.15.110:0/1864517071 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733e00640 1 --2- 172.21.15.110:0/1864517071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 0x7f573406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387069836 0 0) 0x7f57340ae9b0 con 0x7f57340c8840 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57180034e0 con 0x7f57340c8840 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690268681 0 0) 0x7f57340ab320 con 0x7f5734156c60 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57340ae9b0 con 0x7f5734156c60 2024-08-17T02:32:40.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733e00640 1 -- 172.21.15.110:0/1864517071 >> v1:172.21.15.177:6789/0 conn(0x7f5734156c60 legacy=0x7f57340c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733e00640 1 -- 172.21.15.110:0/1864517071 >> v1:172.21.15.110:6789/0 conn(0x7f57340c8840 legacy=0x7f57340ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2123357540 0 0) 0x7f57180034e0 con 0x7f57340c8840 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.282+0000 7f5733e00640 1 -- 172.21.15.110:0/1864517071 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57340aa9f0 con 0x7f5734156890 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.283+0000 7f5733e00640 1 --2- 172.21.15.110:0/1864517071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 0x7f573406dee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5724009880 tx=0x7f57240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=631fc5f7697e4c51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.283+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0017f0 con 0x7f5734156890 2024-08-17T02:32:40.286 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.283+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572402aa30 con 0x7f5734156890 2024-08-17T02:32:40.287 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.283+0000 7f5733400640 1 -- 172.21.15.110:0/1864517071 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572402add0 con 0x7f5734156890 2024-08-17T02:32:40.289 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 -- 172.21.15.110:0/1864517071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 msgr2=0x7f573406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 --2- 172.21.15.110:0/1864517071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 0x7f573406dee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5724009880 tx=0x7f57240090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 -- 172.21.15.110:0/1864517071 shutdown_connections 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 --2- 172.21.15.110:0/1864517071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5734156890 0x7f573406dee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 -- 172.21.15.110:0/1864517071 >> 172.21.15.110:0/1864517071 conn(0x7f5734067750 msgr2=0x7f573406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 -- 172.21.15.110:0/1864517071 shutdown_connections 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.284+0000 7f573ac00640 1 -- 172.21.15.110:0/1864517071 wait complete. 2024-08-17T02:32:40.290 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.286+0000 7f573ac00640 1 Processor -- start 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.286+0000 7f573ac00640 1 -- start start 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57340c8840 0x7f573414f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5734156890 0x7f5734155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 0x7f573406d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573416aea0 con 0x7f5734156c60 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5734149660 con 0x7f5734156890 2024-08-17T02:32:40.291 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f573ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5734149940 con 0x7f57340c8840 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 0x7f573406d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 0x7f573406d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50016/0 (socket says 172.21.15.110:50016) 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 -- 172.21.15.110:0/1320791409 learned_addr learned my addr 172.21.15.110:0/1320791409 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5733e00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57340c8840 0x7f573414f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f572b400640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5734156890 0x7f5734155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.292 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 -- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57340c8840 msgr2=0x7f573414f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57340c8840 0x7f573414f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 -- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5734156890 msgr2=0x7f5734155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5734156890 0x7f5734155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f5738c00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009390 con 0x7f5734156c60 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.287+0000 7f572b400640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5734156890 0x7f5734155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f5738c00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 0x7f573406d4d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f572c00cc40 tx=0x7f572c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.293 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c004b20 con 0x7f5734156c60 2024-08-17T02:32:40.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c004ca0 con 0x7f5734156c60 2024-08-17T02:32:40.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5734149c20 con 0x7f5734156c60 2024-08-17T02:32:40.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00ad20 con 0x7f5734156c60 2024-08-17T02:32:40.294 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.288+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5734155ad0 con 0x7f5734156c60 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.289+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f573416ac00 con 0x7f5734156c60 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.290+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f572c007360 con 0x7f5734156c60 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.290+0000 7f572be00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5710065150 0x7f5710067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f572c081ed0 con 0x7f5734156c60 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f5733e00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5710065150 0x7f5710067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f572be00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7f571006b040 0x7f571006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f571006db00 con 0x7f571006b040 2024-08-17T02:32:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f572c0843d0 con 0x7f5734156c60 2024-08-17T02:32:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f572b400640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7f571006b040 0x7f571006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.291+0000 7f5733e00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5710065150 0x7f5710067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5724034000 tx=0x7f5724032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.292+0000 7f572b400640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7f571006b040 0x7f571006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.297 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.292+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== osd.2 v2:172.21.15.110:6808/37099 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f571006db00 con 0x7f571006b040 2024-08-17T02:32:40.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.305+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 --> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57340710c0 con 0x7f571006b040 2024-08-17T02:32:40.306 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.305+0000 7f572be00640 1 -- 172.21.15.110:0/1320791409 <== osd.2 v2:172.21.15.110:6808/37099 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f57340710c0 con 0x7f571006b040 2024-08-17T02:32:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:40.307 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:40.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.305+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7f571006b040 msgr2=0x7f571006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.305+0000 7f573ac00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6808/37099,v1:172.21.15.110:6809/37099] conn(0x7f571006b040 0x7f571006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.308 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5710065150 msgr2=0x7f5710067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f5710065150 0x7f5710067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5724034000 tx=0x7f5724032000 comp rx=0 tx=0).stop 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 msgr2=0x7f573406d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 --2- 172.21.15.110:0/1320791409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5734156c60 0x7f573406d4d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f572c00cc40 tx=0x7f572c007d60 comp rx=0 tx=0).stop 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f5738c00640 1 -- 172.21.15.110:0/1320791409 reap_dead start 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 shutdown_connections 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 >> 172.21.15.110:0/1320791409 conn(0x7f5734067750 msgr2=0x7f57341485f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.309 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 shutdown_connections 2024-08-17T02:32:40.310 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.306+0000 7f573ac00640 1 -- 172.21.15.110:0/1320791409 wait complete. 2024-08-17T02:32:40.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:32:40.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.468+0000 7f8d65200640 1 Processor -- start 2024-08-17T02:32:40.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.468+0000 7f8d65200640 1 -- start start 2024-08-17T02:32:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.469+0000 7f8d65200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.469+0000 7f8d65200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d60155df0 0x7f8d600ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.469+0000 7f8d65200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d60156670 con 0x7f8d6006d7f0 2024-08-17T02:32:40.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.469+0000 7f8d65200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d600b0350 con 0x7f8d60155df0 2024-08-17T02:32:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.469+0000 7f8d65200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6006e5e0 con 0x7f8d60155a20 2024-08-17T02:32:40.472 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.470+0000 7f8d5de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.470+0000 7f8d55400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d60155df0 0x7f8d600ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.470+0000 7f8d55400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d60155df0 0x7f8d600ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:38630/0 (socket says 172.21.15.110:38630) 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.470+0000 7f8d55400640 1 -- 172.21.15.110:0/2934685418 learned_addr learned my addr 172.21.15.110:0/2934685418 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.470+0000 7f8d5de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.110:59444/0 (socket says 172.21.15.110:59444) 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.471+0000 7f8d55400640 1 -- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 msgr2=0x7f8d600adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.471+0000 7f8d55400640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.473 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.471+0000 7f8d55400640 1 -- 172.21.15.110:0/2934685418 >> v1:172.21.15.177:6789/0 conn(0x7f8d6006d7f0 legacy=0x7f8d600ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.471+0000 7f8d55400640 1 -- 172.21.15.110:0/2934685418 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6006e8c0 con 0x7f8d60155df0 2024-08-17T02:32:40.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.471+0000 7f8d5de00640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:32:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.472+0000 7f8d55400640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155df0 0x7f8d600ad9b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009910 tx=0x7f8d480091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c9339d21925cd50 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.472+0000 7f8d5d400640 1 -- 172.21.15.110:0/2934685418 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4802adb0 con 0x7f8d60155df0 2024-08-17T02:32:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.472+0000 7f8d5d400640 1 -- 172.21.15.110:0/2934685418 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48032440 con 0x7f8d60155df0 2024-08-17T02:32:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.472+0000 7f8d5d400640 1 -- 172.21.15.110:0/2934685418 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48032820 con 0x7f8d60155df0 2024-08-17T02:32:40.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 -- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155df0 msgr2=0x7f8d600ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155df0 0x7f8d600ad9b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009910 tx=0x7f8d480091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 -- 172.21.15.110:0/2934685418 shutdown_connections 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155df0 0x7f8d600ad9b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 --2- 172.21.15.110:0/2934685418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155a20 0x7f8d600adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 -- 172.21.15.110:0/2934685418 >> 172.21.15.110:0/2934685418 conn(0x7f8d600cb9b0 msgr2=0x7f8d600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 -- 172.21.15.110:0/2934685418 shutdown_connections 2024-08-17T02:32:40.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.473+0000 7f8d65200640 1 -- 172.21.15.110:0/2934685418 wait complete. 2024-08-17T02:32:40.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.474+0000 7f8d65200640 1 Processor -- start 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.474+0000 7f8d65200640 1 -- start start 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155a20 0x7f8d600a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155df0 0x7f8d60151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60150540 con 0x7f8d6006d7f0 2024-08-17T02:32:40.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d60151370 con 0x7f8d60155a20 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.475+0000 7f8d65200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6014f930 con 0x7f8d60155df0 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50024/0 (socket says 172.21.15.110:50024) 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 -- 172.21.15.110:0/3263570652 learned_addr learned my addr 172.21.15.110:0/3263570652 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d55400640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155a20 0x7f8d600a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.480 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5e800640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155df0 0x7f8d60151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 -- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155df0 msgr2=0x7f8d60151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155df0 0x7f8d60151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 -- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155a20 msgr2=0x7f8d600a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155a20 0x7f8d600a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 -- 172.21.15.110:0/3263570652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d50009390 con 0x7f8d6006d7f0 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.476+0000 7f8d5de00640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ec80 tx=0x7f8d500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.477+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000eec0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.477+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5000cbc0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.477+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d48009450 con 0x7f8d6006d7f0 2024-08-17T02:32:40.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.477+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50013470 con 0x7f8d6006d7f0 2024-08-17T02:32:40.482 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.477+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6014fef0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.478+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d601615c0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.479+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8d500137e0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.479+0000 7f8d56000640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 0x7f8d3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.480+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8d500826d0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.480+0000 7f8d55400640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 0x7f8d3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.480+0000 7f8d55400640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 0x7f8d3c067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d48032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.485 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.483+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8d601615c0 con 0x7f8d6006d7f0 2024-08-17T02:32:40.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.655+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d601615c0 con 0x7f8d3c065150 2024-08-17T02:32:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.656+0000 7f8d56000640 1 -- 172.21.15.110:0/3263570652 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8d601615c0 con 0x7f8d3c065150 2024-08-17T02:32:40.658 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 msgr2=0x7f8d3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 0x7f8d3c067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d48032000 comp rx=0 tx=0).stop 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 msgr2=0x7f8d60150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000ec80 tx=0x7f8d500090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 shutdown_connections 2024-08-17T02:32:40.660 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8d3c065150 0x7f8d3c067600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d60155df0 0x7f8d60151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d60155a20 0x7f8d600a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 --2- 172.21.15.110:0/3263570652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d6006d7f0 0x7f8d60150e30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 >> 172.21.15.110:0/3263570652 conn(0x7f8d600cb9b0 msgr2=0x7f8d60152570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 shutdown_connections 2024-08-17T02:32:40.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.658+0000 7f8d65200640 1 -- 172.21.15.110:0/3263570652 wait complete. 2024-08-17T02:32:40.674 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:32:40.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.826+0000 7f9e04200640 1 Processor -- start 2024-08-17T02:32:40.827 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.826+0000 7f9e04200640 1 -- start start 2024-08-17T02:32:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9dfc150130 0x7f9dfc0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 0x7f9dfc06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc0afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.829 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc06e880 con 0x7f9dfc150130 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc1568b0 con 0x7f9dfc156d40 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e04200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc150500 con 0x7f9dfc06e420 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e01800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9dfc150130 0x7f9dfc0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e01800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9dfc150130 0x7f9dfc0aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50038/0 (socket says 172.21.15.110:50038) 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e01800640 1 -- 172.21.15.110:0/1374605268 learned_addr learned my addr 172.21.15.110:0/1374605268 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:40.830 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e02200640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc0afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.827+0000 7f9e00e00640 1 --2- 172.21.15.110:0/1374605268 >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 0x7f9dfc06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e01800640 1 -- 172.21.15.110:0/1374605268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 msgr2=0x7f9dfc0afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e01800640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc0afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e01800640 1 -- 172.21.15.110:0/1374605268 >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 msgr2=0x7f9dfc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e01800640 1 --2- 172.21.15.110:0/1374605268 >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 0x7f9dfc06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e01800640 1 -- 172.21.15.110:0/1374605268 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc155fc0 con 0x7f9dfc150130 2024-08-17T02:32:40.831 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.828+0000 7f9e00e00640 1 --2- 172.21.15.110:0/1374605268 >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 0x7f9dfc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.829+0000 7f9e01800640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc0aa730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc065f80 tx=0x7f9df00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6de18316297d01c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.829+0000 7f9dfbe00640 1 -- 172.21.15.110:0/1374605268 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df002ad40 con 0x7f9dfc150130 2024-08-17T02:32:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.829+0000 7f9dfbe00640 1 -- 172.21.15.110:0/1374605268 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0032440 con 0x7f9dfc150130 2024-08-17T02:32:40.833 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.829+0000 7f9dfbe00640 1 -- 172.21.15.110:0/1374605268 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df002aea0 con 0x7f9dfc150130 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.829+0000 7f9e04200640 1 -- 172.21.15.110:0/1374605268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 msgr2=0x7f9dfc0aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc0aa730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc065f80 tx=0x7f9df00091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 -- 172.21.15.110:0/1374605268 shutdown_connections 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc0afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 --2- 172.21.15.110:0/1374605268 >> v2:172.21.15.177:3300/0 conn(0x7f9dfc156d40 0x7f9dfc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 --2- 172.21.15.110:0/1374605268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc0aa730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.834 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 -- 172.21.15.110:0/1374605268 >> 172.21.15.110:0/1374605268 conn(0x7f9dfc067750 msgr2=0x7f9dfc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 -- 172.21.15.110:0/1374605268 shutdown_connections 2024-08-17T02:32:40.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.830+0000 7f9e04200640 1 -- 172.21.15.110:0/1374605268 wait complete. 2024-08-17T02:32:40.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.831+0000 7f9e04200640 1 Processor -- start 2024-08-17T02:32:40.835 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.831+0000 7f9e04200640 1 -- start start 2024-08-17T02:32:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dfc156d40 0x7f9dfc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc151190 con 0x7f9dfc150130 2024-08-17T02:32:40.838 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc153ba0 con 0x7f9dfc156d40 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e04200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc153e80 con 0x7f9dfc06e420 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e00e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e00e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50050/0 (socket says 172.21.15.110:50050) 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.832+0000 7f9e00e00640 1 -- 172.21.15.110:0/4046928791 learned_addr learned my addr 172.21.15.110:0/4046928791 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e01800640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.839 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e02200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dfc156d40 0x7f9dfc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 -- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 msgr2=0x7f9dfc149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9dfc06e420 0x7f9dfc149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 -- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dfc156d40 msgr2=0x7f9dfc155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9dfc156d40 0x7f9dfc155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009450 con 0x7f9dfc150130 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9e00e00640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc153350 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9de800d7e0 tx=0x7f9de8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de80096a0 con 0x7f9dfc150130 2024-08-17T02:32:40.840 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.833+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de8009800 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.834+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8009b80 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.834+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc150b40 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.834+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc153890 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.834+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9dfc1509a0 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.835+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9de8014430 con 0x7f9dfc150130 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9df8c00640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9ddc065150 0x7f9ddc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.841 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9de80825d0 con 0x7f9dfc150130 2024-08-17T02:32:40.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9df8c00640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f9ddc06b040 0x7f9ddc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:40.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ddc06db00 con 0x7f9ddc06b040 2024-08-17T02:32:40.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9de8084ad0 con 0x7f9dfc150130 2024-08-17T02:32:40.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.836+0000 7f9e01800640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9ddc065150 0x7f9ddc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.837+0000 7f9e02200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f9ddc06b040 0x7f9ddc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:40.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.837+0000 7f9e01800640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9ddc065150 0x7f9ddc067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9df0034000 tx=0x7f9df0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.837+0000 7f9e02200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f9ddc06b040 0x7f9ddc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:40.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.838+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== osd.3 v2:172.21.15.110:6815/37098 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9ddc06db00 con 0x7f9ddc06b040 2024-08-17T02:32:40.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.850+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 --> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9dfc0710c0 con 0x7f9ddc06b040 2024-08-17T02:32:40.852 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9df8c00640 1 -- 172.21.15.110:0/4046928791 <== osd.3 v2:172.21.15.110:6815/37098 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9dfc0710c0 con 0x7f9ddc06b040 2024-08-17T02:32:40.852 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:40.853 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:40.853 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f9ddc06b040 msgr2=0x7f9ddc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6815/37098,v1:172.21.15.110:6817/37098] conn(0x7f9ddc06b040 0x7f9ddc06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9ddc065150 msgr2=0x7f9ddc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9ddc065150 0x7f9ddc067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9df0034000 tx=0x7f9df0032000 comp rx=0 tx=0).stop 2024-08-17T02:32:40.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 msgr2=0x7f9dfc153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 --2- 172.21.15.110:0/4046928791 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9dfc150130 0x7f9dfc153350 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9de800d7e0 tx=0x7f9de8008040 comp rx=0 tx=0).stop 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e02200640 1 -- 172.21.15.110:0/4046928791 reap_dead start 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 shutdown_connections 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 >> 172.21.15.110:0/4046928791 conn(0x7f9dfc067750 msgr2=0x7f9dfc069650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 shutdown_connections 2024-08-17T02:32:40.855 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:40.851+0000 7f9e04200640 1 -- 172.21.15.110:0/4046928791 wait complete. 2024-08-17T02:32:40.866 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:32:41.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.012+0000 7f81c1600640 1 Processor -- start 2024-08-17T02:32:41.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.013+0000 7f81c1600640 1 -- start start 2024-08-17T02:32:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81bc0ca8a0 0x7f81bc0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f81bc0ccad0 0x7f81bc0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc0cd6e0 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc0ccf70 con 0x7f81bc0ccad0 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c1600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0cadc0 con 0x7f81bc159ca0 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81b3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81bc0ca8a0 0x7f81bc0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81b3400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81bc0ca8a0 0x7f81bc0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50064/0 (socket says 172.21.15.110:50064) 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81b3400640 1 -- 172.21.15.110:0/2445706222 learned_addr learned my addr 172.21.15.110:0/2445706222 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81c0c00640 1 --2- 172.21.15.110:0/2445706222 >> v2:172.21.15.177:3300/0 conn(0x7f81bc0ccad0 0x7f81bc0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.014+0000 7f81bbe00640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.015+0000 7f81b3400640 1 -- 172.21.15.110:0/2445706222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 msgr2=0x7f81bc0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.015+0000 7f81b3400640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.015+0000 7f81b3400640 1 -- 172.21.15.110:0/2445706222 >> v2:172.21.15.177:3300/0 conn(0x7f81bc0ccad0 msgr2=0x7f81bc0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.015+0000 7f81b3400640 1 --2- 172.21.15.110:0/2445706222 >> v2:172.21.15.177:3300/0 conn(0x7f81bc0ccad0 0x7f81bc0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.015+0000 7f81b3400640 1 -- 172.21.15.110:0/2445706222 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0cb060 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81b3400640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc0cc590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b5c60 tx=0x7f81a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9520522a2565a2a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81bb400640 1 -- 172.21.15.110:0/2445706222 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a402add0 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81bb400640 1 -- 172.21.15.110:0/2445706222 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4032440 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81bb400640 1 -- 172.21.15.110:0/2445706222 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4032820 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81c1600640 1 -- 172.21.15.110:0/2445706222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ca8a0 msgr2=0x7f81bc0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.016+0000 7f81c1600640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc0cc590 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f81bc0b5c60 tx=0x7f81a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 -- 172.21.15.110:0/2445706222 shutdown_connections 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 --2- 172.21.15.110:0/2445706222 >> v2:172.21.15.177:3300/0 conn(0x7f81bc0ccad0 0x7f81bc0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc0cc590 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 --2- 172.21.15.110:0/2445706222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 -- 172.21.15.110:0/2445706222 >> 172.21.15.110:0/2445706222 conn(0x7f81bc098e00 msgr2=0x7f81bc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 -- 172.21.15.110:0/2445706222 shutdown_connections 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.017+0000 7f81c1600640 1 -- 172.21.15.110:0/2445706222 wait complete. 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.018+0000 7f81c1600640 1 Processor -- start 2024-08-17T02:32:41.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.018+0000 7f81c1600640 1 -- start start 2024-08-17T02:32:41.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc0c8d80 con 0x7f81bc0ccad0 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc150dd0 con 0x7f81bc0ca8a0 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c1600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1510b0 con 0x7f81bc159ca0 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81b3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81b3400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50076/0 (socket says 172.21.15.110:50076) 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81b3400640 1 -- 172.21.15.110:0/623270529 learned_addr learned my addr 172.21.15.110:0/623270529 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81c0c00640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.019+0000 7f81bbe00640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 -- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 msgr2=0x7f81bc150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 -- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81bc0ca8a0 msgr2=0x7f81bc068760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc068760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 -- 172.21.15.110:0/623270529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4009450 con 0x7f81bc0ccad0 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3400640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f81a4035040 tx=0x7f81a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4031800 con 0x7f81bc0ccad0 2024-08-17T02:32:41.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a40319a0 con 0x7f81bc0ccad0 2024-08-17T02:32:41.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc151390 con 0x7f81bc0ccad0 2024-08-17T02:32:41.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4031d60 con 0x7f81bc0ccad0 2024-08-17T02:32:41.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.020+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc151950 con 0x7f81bc0ccad0 2024-08-17T02:32:41.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.021+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81bc0691e0 con 0x7f81bc0ccad0 2024-08-17T02:32:41.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.022+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f81a4039040 con 0x7f81bc0ccad0 2024-08-17T02:32:41.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.023+0000 7f81b3e00640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 0x7f8198067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.023+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f81a4041030 con 0x7f81bc0ccad0 2024-08-17T02:32:41.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.023+0000 7f81bbe00640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 0x7f8198067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.027 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.024+0000 7f81bbe00640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 0x7f8198067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009c10 tx=0x7f81ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.029 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.027+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f81bc0691e0 con 0x7f81bc0ccad0 2024-08-17T02:32:41.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.201+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f81bc1566b0 con 0x7f8198065150 2024-08-17T02:32:41.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.201+0000 7f81b3e00640 1 -- 172.21.15.110:0/623270529 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f81bc1566b0 con 0x7f8198065150 2024-08-17T02:32:41.203 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 msgr2=0x7f8198067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 0x7f8198067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009c10 tx=0x7f81ac008040 comp rx=0 tx=0).stop 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 msgr2=0x7f81bc150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f81a4035040 tx=0x7f81a4032000 comp rx=0 tx=0).stop 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 shutdown_connections 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8198065150 0x7f8198067600 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81bc159ca0 0x7f81bc150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81bc0ccad0 0x7f81bc150210 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 --2- 172.21.15.110:0/623270529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81bc0ca8a0 0x7f81bc068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 >> 172.21.15.110:0/623270529 conn(0x7f81bc098e00 msgr2=0x7f81bc158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 shutdown_connections 2024-08-17T02:32:41.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.203+0000 7f81c1600640 1 -- 172.21.15.110:0/623270529 wait complete. 2024-08-17T02:32:41.219 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:32:41.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:41.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.370+0000 7f6cf4e00640 1 Processor -- start 2024-08-17T02:32:41.371 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.370+0000 7f6cf4e00640 1 -- start start 2024-08-17T02:32:41.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cf4e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 0x7f6cf00b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cf4e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cf015c4b0 0x7f6cf00aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.373 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cf4e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf00d0a80 con 0x7f6cf00b5740 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cf4e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00b2130 con 0x7f6cf015c4b0 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cf4e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00b23f0 con 0x7f6cf00b2bb0 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cefe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cf015c4b0 0x7f6cf00aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cefe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cf015c4b0 0x7f6cf00aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50082/0 (socket says 172.21.15.110:50082) 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.371+0000 7f6cefe00640 1 -- 172.21.15.110:0/1153038266 learned_addr learned my addr 172.21.15.110:0/1153038266 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cef400640 1 --2- 172.21.15.110:0/1153038266 >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 0x7f6cf00b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cefe00640 1 -- 172.21.15.110:0/1153038266 >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 msgr2=0x7f6cf00b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.374 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cefe00640 1 --2- 172.21.15.110:0/1153038266 >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 0x7f6cf00b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cefe00640 1 -- 172.21.15.110:0/1153038266 >> v1:172.21.15.110:6789/0 conn(0x7f6cf00b5740 legacy=0x7f6cf015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cefe00640 1 -- 172.21.15.110:0/1153038266 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00b37a0 con 0x7f6cf015c4b0 2024-08-17T02:32:41.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6ceea00640 1 -- 172.21.15.110:0/1153038266 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163386472 0 0) 0x7f6cf00d0a80 con 0x7f6cf00b5740 2024-08-17T02:32:41.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.372+0000 7f6cef400640 1 --2- 172.21.15.110:0/1153038266 >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 0x7f6cf00b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:41.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.373+0000 7f6cefe00640 1 --2- 172.21.15.110:0/1153038266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00aac20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0070bc0 tx=0x7f6ce8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23363918ed1a4a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.376 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.373+0000 7f6ceea00640 1 -- 172.21.15.110:0/1153038266 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8032470 con 0x7f6cf015c4b0 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.373+0000 7f6ceea00640 1 -- 172.21.15.110:0/1153038266 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce80325d0 con 0x7f6cf015c4b0 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.373+0000 7f6ceea00640 1 -- 172.21.15.110:0/1153038266 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8032970 con 0x7f6cf015c4b0 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 -- 172.21.15.110:0/1153038266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 msgr2=0x7f6cf00aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/1153038266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00aac20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0070bc0 tx=0x7f6ce8009840 comp rx=0 tx=0).stop 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 -- 172.21.15.110:0/1153038266 shutdown_connections 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/1153038266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00aac20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/1153038266 >> v2:172.21.15.177:3300/0 conn(0x7f6cf00b2bb0 0x7f6cf00b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.377 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 -- 172.21.15.110:0/1153038266 >> 172.21.15.110:0/1153038266 conn(0x7f6cf00cfbc0 msgr2=0x7f6cf00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 -- 172.21.15.110:0/1153038266 shutdown_connections 2024-08-17T02:32:41.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.374+0000 7f6cf4e00640 1 -- 172.21.15.110:0/1153038266 wait complete. 2024-08-17T02:32:41.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.375+0000 7f6cf4e00640 1 Processor -- start 2024-08-17T02:32:41.378 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.375+0000 7f6cf4e00640 1 -- start start 2024-08-17T02:32:41.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cf00b2bb0 0x7f6cf0152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf00b5740 0x7f6cf015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.380 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf01533f0 con 0x7f6cf015c4b0 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf015e340 con 0x7f6cf00b5740 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cf4e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf015d2a0 con 0x7f6cf00b2bb0 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cefe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00ad240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50086/0 (socket says 172.21.15.110:50086) 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.376+0000 7f6cefe00640 1 -- 172.21.15.110:0/4092369226 learned_addr learned my addr 172.21.15.110:0/4092369226 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 -- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cf00b2bb0 msgr2=0x7f6cf0152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cf00b2bb0 0x7f6cf0152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.381 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6ce7e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf00b5740 0x7f6cf015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 -- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf00b5740 msgr2=0x7f6cf015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf00b5740 0x7f6cf015c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8009ae0 con 0x7f6cf015c4b0 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6ce7e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cf00b5740 0x7f6cf015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cefe00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00ad240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6ce802ade0 tx=0x7f6ce8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8032470 con 0x7f6cf015c4b0 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8008e50 con 0x7f6cf015c4b0 2024-08-17T02:32:41.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf015d580 con 0x7f6cf015c4b0 2024-08-17T02:32:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.377+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce803c640 con 0x7f6cf015c4b0 2024-08-17T02:32:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.378+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf015db40 con 0x7f6cf015c4b0 2024-08-17T02:32:41.383 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.378+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cf0071050 con 0x7f6cf015c4b0 2024-08-17T02:32:41.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.379+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6ce8039050 con 0x7f6cf015c4b0 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6ce6a00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6ccc065150 0x7f6ccc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6ce80a2f70 con 0x7f6cf015c4b0 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6ce6a00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f6ccc06b040 0x7f6ccc06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6cef400640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6ccc065150 0x7f6ccc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ccc06db00 con 0x7f6ccc06b040 2024-08-17T02:32:41.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.380+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce80a54d0 con 0x7f6cf015c4b0 2024-08-17T02:32:41.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.381+0000 7f6ce7e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f6ccc06b040 0x7f6ccc06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.381+0000 7f6cef400640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6ccc065150 0x7f6ccc067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0006e70 tx=0x7f6ce0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.382+0000 7f6ce7e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f6ccc06b040 0x7f6ccc06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.382+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== osd.4 v2:172.21.15.177:6800/37516 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6ccc06db00 con 0x7f6ccc06b040 2024-08-17T02:32:41.396 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.395+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 --> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6cf00af360 con 0x7f6ccc06b040 2024-08-17T02:32:41.397 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6ce6a00640 1 -- 172.21.15.110:0/4092369226 <== osd.4 v2:172.21.15.177:6800/37516 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6cf00af360 con 0x7f6ccc06b040 2024-08-17T02:32:41.397 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:41.397 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:41.398 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:41.398 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f6ccc06b040 msgr2=0x7f6ccc06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.177:6800/37516,v1:172.21.15.177:6801/37516] conn(0x7f6ccc06b040 0x7f6ccc06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6ccc065150 msgr2=0x7f6ccc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f6ccc065150 0x7f6ccc067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0006e70 tx=0x7f6ce0008040 comp rx=0 tx=0).stop 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 msgr2=0x7f6cf00ad240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 --2- 172.21.15.110:0/4092369226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cf015c4b0 0x7f6cf00ad240 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6ce802ade0 tx=0x7f6ce8037000 comp rx=0 tx=0).stop 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cefe00640 1 -- 172.21.15.110:0/4092369226 reap_dead start 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 shutdown_connections 2024-08-17T02:32:41.399 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 >> 172.21.15.110:0/4092369226 conn(0x7f6cf00cfbc0 msgr2=0x7f6cf00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.396+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 shutdown_connections 2024-08-17T02:32:41.400 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.397+0000 7f6cf4e00640 1 -- 172.21.15.110:0/4092369226 wait complete. 2024-08-17T02:32:41.411 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:32:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.560+0000 7fcbb2000640 1 Processor -- start 2024-08-17T02:32:41.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.560+0000 7fcbb2000640 1 -- start start 2024-08-17T02:32:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbb2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbac155a20 0x7fcbac0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbb2000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcbac06df00 0x7fcbac0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbb2000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac156670 con 0x7fcbac155df0 2024-08-17T02:32:41.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbb2000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0b0350 con 0x7fcbac155a20 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbb2000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac06e5e0 con 0x7fcbac06df00 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbab400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbac155a20 0x7fcbac0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbab400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbac155a20 0x7fcbac0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50090/0 (socket says 172.21.15.110:50090) 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.561+0000 7fcbab400640 1 -- 172.21.15.110:0/4248510008 learned_addr learned my addr 172.21.15.110:0/4248510008 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.562+0000 7fcbabe00640 1 --2- 172.21.15.110:0/4248510008 >> v2:172.21.15.177:3300/0 conn(0x7fcbac06df00 0x7fcbac0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.562+0000 7fcbab400640 1 -- 172.21.15.110:0/4248510008 >> v2:172.21.15.177:3300/0 conn(0x7fcbac06df00 msgr2=0x7fcbac0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.562+0000 7fcbab400640 1 --2- 172.21.15.110:0/4248510008 >> v2:172.21.15.177:3300/0 conn(0x7fcbac06df00 0x7fcbac0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.562+0000 7fcbab400640 1 -- 172.21.15.110:0/4248510008 >> v1:172.21.15.177:6789/0 conn(0x7fcbac155df0 legacy=0x7fcbac06d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.562+0000 7fcbab400640 1 -- 172.21.15.110:0/4248510008 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac06e8c0 con 0x7fcbac155a20 2024-08-17T02:32:41.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.563+0000 7fcbab400640 1 --2- 172.21.15.110:0/4248510008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0adf10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcbac1565e0 tx=0x7fcb9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b24df1976e7cdc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.563+0000 7fcbaa000640 1 -- 172.21.15.110:0/4248510008 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c02ad50 con 0x7fcbac155a20 2024-08-17T02:32:41.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.563+0000 7fcbaa000640 1 -- 172.21.15.110:0/4248510008 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c032440 con 0x7fcbac155a20 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.563+0000 7fcbaa000640 1 -- 172.21.15.110:0/4248510008 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c032820 con 0x7fcbac155a20 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 -- 172.21.15.110:0/4248510008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 msgr2=0x7fcbac0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 --2- 172.21.15.110:0/4248510008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0adf10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fcbac1565e0 tx=0x7fcb9c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 -- 172.21.15.110:0/4248510008 shutdown_connections 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 --2- 172.21.15.110:0/4248510008 >> v2:172.21.15.177:3300/0 conn(0x7fcbac06df00 0x7fcbac0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 --2- 172.21.15.110:0/4248510008 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0adf10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 -- 172.21.15.110:0/4248510008 >> 172.21.15.110:0/4248510008 conn(0x7fcbac0cb9b0 msgr2=0x7fcbac0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 -- 172.21.15.110:0/4248510008 shutdown_connections 2024-08-17T02:32:41.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.564+0000 7fcbb2000640 1 -- 172.21.15.110:0/4248510008 wait complete. 2024-08-17T02:32:41.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.565+0000 7fcbb2000640 1 Processor -- start 2024-08-17T02:32:41.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.565+0000 7fcbb2000640 1 -- start start 2024-08-17T02:32:41.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac06df00 0x7fcbac0c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac155df0 0x7fcbac0c10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.570 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c26b0 con 0x7fcbac155a20 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c1aa0 con 0x7fcbac155df0 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbb2000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c1d80 con 0x7fcbac06df00 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50106/0 (socket says 172.21.15.110:50106) 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbab400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac06df00 0x7fcbac0c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.566+0000 7fcbaaa00640 1 -- 172.21.15.110:0/1034681779 learned_addr learned my addr 172.21.15.110:0/1034681779 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbabe00640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac155df0 0x7fcbac0c10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 -- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac06df00 msgr2=0x7fcbac0c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac06df00 0x7fcbac0c2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 -- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac155df0 msgr2=0x7fcbac0c10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac155df0 0x7fcbac0c10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 -- 172.21.15.110:0/1034681779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c009450 con 0x7fcbac155a20 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbaaa00640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b4c0 tx=0x7fcb98009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800f510 con 0x7fcbac155a20 2024-08-17T02:32:41.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800f670 con 0x7fcbac155a20 2024-08-17T02:32:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.567+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0c2060 con 0x7fcbac155a20 2024-08-17T02:32:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.568+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800fa30 con 0x7fcbac155a20 2024-08-17T02:32:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.568+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0c3b50 con 0x7fcbac155a20 2024-08-17T02:32:41.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.569+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac064db0 con 0x7fcbac155a20 2024-08-17T02:32:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.569+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb9801a400 con 0x7fcbac155a20 2024-08-17T02:32:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.570+0000 7fcba2a00640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 0x7fcb8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.570+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcb98081c60 con 0x7fcbac155a20 2024-08-17T02:32:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.570+0000 7fcbab400640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 0x7fcb8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.574 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.571+0000 7fcbab400640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 0x7fcb8c067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c034000 tx=0x7fcb9c032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.575 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.574+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb98050050 con 0x7fcbac155a20 2024-08-17T02:32:41.749 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.748+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbac06c110 con 0x7fcb8c065150 2024-08-17T02:32:41.750 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.748+0000 7fcba2a00640 1 -- 172.21.15.110:0/1034681779 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcbac06c110 con 0x7fcb8c065150 2024-08-17T02:32:41.750 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:32:41.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 msgr2=0x7fcb8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 0x7fcb8c067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c034000 tx=0x7fcb9c032000 comp rx=0 tx=0).stop 2024-08-17T02:32:41.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 msgr2=0x7fcbac0c3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b4c0 tx=0x7fcb98009060 comp rx=0 tx=0).stop 2024-08-17T02:32:41.752 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 shutdown_connections 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcb8c065150 0x7fcb8c067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac155df0 0x7fcbac0c10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbac155a20 0x7fcbac0c3610 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 --2- 172.21.15.110:0/1034681779 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac06df00 0x7fcbac0c2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 >> 172.21.15.110:0/1034681779 conn(0x7fcbac0cb9b0 msgr2=0x7fcbac0687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 shutdown_connections 2024-08-17T02:32:41.753 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.751+0000 7fcbb2000640 1 -- 172.21.15.110:0/1034681779 wait complete. 2024-08-17T02:32:41.767 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:32:41.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:41.918 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.917+0000 7fcd2ae00640 1 Processor -- start 2024-08-17T02:32:41.919 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.917+0000 7fcd2ae00640 1 -- start start 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd2ae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd240c8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd2ae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd240ae9b0 con 0x7fcd24156890 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd2ae00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd240ab320 con 0x7fcd24156c60 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd2ae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240aa730 con 0x7fcd2406e5f0 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd23e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcd24156890 0x7fcd2406dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46334/0 (socket says 172.21.15.110:46334) 2024-08-17T02:32:41.920 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.918+0000 7fcd23e00640 1 -- 172.21.15.110:0/3088473608 learned_addr learned my addr 172.21.15.110:0/3088473608 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd23400640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd240c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895644720 0 0) 0x7fcd240ae9b0 con 0x7fcd24156890 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd080034e0 con 0x7fcd24156890 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476963557 0 0) 0x7fcd080034e0 con 0x7fcd24156890 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 msgr2=0x7fcd240c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd240c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 >> v1:172.21.15.177:6789/0 conn(0x7fcd24156c60 legacy=0x7fcd240ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd240aa9f0 con 0x7fcd24156890 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7fcd14001470 con 0x7fcd24156890 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 >> v1:172.21.15.110:6789/0 conn(0x7fcd24156890 legacy=0x7fcd2406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd08003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd08003f40 0x7fcd08004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd08004cc0 0x7fcd08005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240aa730 con 0x7fcd08004cc0 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0800bab0 con 0x7fcd08003f40 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.919+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0800bc70 con 0x7fcd2406e5f0 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd08004cc0 0x7fcd08005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd23e00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd08003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd23400640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd08003f40 0x7fcd08004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 -- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 msgr2=0x7fcd08003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd2406e5f0 0x7fcd08003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 -- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd08003f40 msgr2=0x7fcd08004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd08003f40 0x7fcd08004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.920+0000 7fcd28e00640 1 -- 172.21.15.110:0/3088473608 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080034e0 con 0x7fcd08004cc0 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.921+0000 7fcd28e00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd08004cc0 0x7fcd08005130 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002010 tx=0x7fcd1c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c7dfc6a14ca986 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.921+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c031440 con 0x7fcd08004cc0 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.921+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c02d050 con 0x7fcd08004cc0 2024-08-17T02:32:41.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.921+0000 7fcd22a00640 1 -- 172.21.15.110:0/3088473608 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c031850 con 0x7fcd08004cc0 2024-08-17T02:32:41.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 -- 172.21.15.110:0/3088473608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd08004cc0 msgr2=0x7fcd08005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 --2- 172.21.15.110:0/3088473608 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd08004cc0 0x7fcd08005130 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c002010 tx=0x7fcd1c001640 comp rx=0 tx=0).stop 2024-08-17T02:32:41.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd28e00640 1 -- 172.21.15.110:0/3088473608 reap_dead start 2024-08-17T02:32:41.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 -- 172.21.15.110:0/3088473608 shutdown_connections 2024-08-17T02:32:41.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 -- 172.21.15.110:0/3088473608 >> 172.21.15.110:0/3088473608 conn(0x7fcd24067750 msgr2=0x7fcd2406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 -- 172.21.15.110:0/3088473608 shutdown_connections 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.922+0000 7fcd2ae00640 1 -- 172.21.15.110:0/3088473608 wait complete. 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.923+0000 7fcd2ae00640 1 Processor -- start 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 -- start start 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd08004cc0 0x7fcd2414c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 0x7fcd24136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd24136aa0 0x7fcd2414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.930 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2414d950 con 0x7fcd2414ca10 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241386e0 con 0x7fcd24136aa0 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.924+0000 7fcd2ae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd24138f80 con 0x7fcd08004cc0 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 0x7fcd24136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 0x7fcd24136560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50124/0 (socket says 172.21.15.110:50124) 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 -- 172.21.15.110:0/2951629293 learned_addr learned my addr 172.21.15.110:0/2951629293 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd28e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd24136aa0 0x7fcd2414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd08004cc0 0x7fcd2414c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 -- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd08004cc0 msgr2=0x7fcd2414c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd08004cc0 0x7fcd2414c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 -- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd24136aa0 msgr2=0x7fcd2414e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd24136aa0 0x7fcd2414e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24136f40 con 0x7fcd2414ca10 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd08004cc0 0x7fcd2414c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.925+0000 7fcd23400640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 0x7fcd24136560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcd10011b70 tx=0x7fcd100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.926+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000fb60 con 0x7fcd2414ca10 2024-08-17T02:32:41.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.926+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000fcc0 con 0x7fcd2414ca10 2024-08-17T02:32:41.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.926+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2414eec0 con 0x7fcd2414ca10 2024-08-17T02:32:41.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.926+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10014440 con 0x7fcd2414ca10 2024-08-17T02:32:41.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.926+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd24138c10 con 0x7fcd2414ca10 2024-08-17T02:32:41.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.927+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd240710c0 con 0x7fcd2414ca10 2024-08-17T02:32:41.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.927+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcd10014830 con 0x7fcd2414ca10 2024-08-17T02:32:41.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.928+0000 7fcd1b400640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcd04065150 0x7fcd04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.928+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcd10018030 con 0x7fcd2414ca10 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd23e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcd04065150 0x7fcd04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd1b400640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fcd0406b040 0x7fcd0406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd0406db00 con 0x7fcd0406b040 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd10088440 con 0x7fcd2414ca10 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd28e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fcd0406b040 0x7fcd0406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.929+0000 7fcd23e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcd04065150 0x7fcd04067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcd14001d00 tx=0x7fcd14009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.930+0000 7fcd28e00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fcd0406b040 0x7fcd0406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:41.936 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.930+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== osd.5 v2:172.21.15.177:6804/37515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcd0406db00 con 0x7fcd0406b040 2024-08-17T02:32:41.944 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.943+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 --> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd24070740 con 0x7fcd0406b040 2024-08-17T02:32:41.945 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd1b400640 1 -- 172.21.15.110:0/2951629293 <== osd.5 v2:172.21.15.177:6804/37515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcd24070740 con 0x7fcd0406b040 2024-08-17T02:32:41.945 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:41.946 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:41.946 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:41.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fcd0406b040 msgr2=0x7fcd0406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.177:6804/37515,v1:172.21.15.177:6806/37515] conn(0x7fcd0406b040 0x7fcd0406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcd04065150 msgr2=0x7fcd04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.947 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcd04065150 0x7fcd04067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcd14001d00 tx=0x7fcd14009040 comp rx=0 tx=0).stop 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 msgr2=0x7fcd24136560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 --2- 172.21.15.110:0/2951629293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2414ca10 0x7fcd24136560 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fcd10011b70 tx=0x7fcd100090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd28e00640 1 -- 172.21.15.110:0/2951629293 reap_dead start 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.944+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 shutdown_connections 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.945+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 >> 172.21.15.110:0/2951629293 conn(0x7fcd24067750 msgr2=0x7fcd24154910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.945+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 shutdown_connections 2024-08-17T02:32:41.948 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:41.945+0000 7fcd2ae00640 1 -- 172.21.15.110:0/2951629293 wait complete. 2024-08-17T02:32:41.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:32:42.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 Processor -- start 2024-08-17T02:32:42.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 -- start start 2024-08-17T02:32:42.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd08415cb30 0x7fd0840c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840b18d0 con 0x7fd084158d60 2024-08-17T02:32:42.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0840b0d00 con 0x7fd084159130 2024-08-17T02:32:42.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.109+0000 7fd08a600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0840b0fa0 con 0x7fd08415cb30 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd083400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd084158d60 0x7fd0840b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46340/0 (socket says 172.21.15.110:46340) 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd083400640 1 -- 172.21.15.110:0/3718741592 learned_addr learned my addr 172.21.15.110:0/3718741592 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd082a00640 1 --2- 172.21.15.110:0/3718741592 >> v2:172.21.15.110:3300/0 conn(0x7fd08415cb30 0x7fd0840c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd082a00640 1 -- 172.21.15.110:0/3718741592 >> v1:172.21.15.177:6789/0 conn(0x7fd084159130 legacy=0x7fd084096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd082a00640 1 -- 172.21.15.110:0/3718741592 >> v1:172.21.15.110:6789/0 conn(0x7fd084158d60 legacy=0x7fd0840b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.110+0000 7fd082a00640 1 -- 172.21.15.110:0/3718741592 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0840b1280 con 0x7fd08415cb30 2024-08-17T02:32:42.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.111+0000 7fd082a00640 1 --2- 172.21.15.110:0/3718741592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08415cb30 0x7fd0840c6d10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd070009880 tx=0x7fd0700090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33c7774a09dd9ce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd082000640 1 -- 172.21.15.110:0/3718741592 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07002ae20 con 0x7fd08415cb30 2024-08-17T02:32:42.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd082000640 1 -- 172.21.15.110:0/3718741592 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070032440 con 0x7fd08415cb30 2024-08-17T02:32:42.113 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd082000640 1 -- 172.21.15.110:0/3718741592 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070032820 con 0x7fd08415cb30 2024-08-17T02:32:42.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 -- 172.21.15.110:0/3718741592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08415cb30 msgr2=0x7fd0840c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 --2- 172.21.15.110:0/3718741592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08415cb30 0x7fd0840c6d10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd070009880 tx=0x7fd0700090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.114 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 -- 172.21.15.110:0/3718741592 shutdown_connections 2024-08-17T02:32:42.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 --2- 172.21.15.110:0/3718741592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd08415cb30 0x7fd0840c6d10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 -- 172.21.15.110:0/3718741592 >> 172.21.15.110:0/3718741592 conn(0x7fd0840b3040 msgr2=0x7fd0840b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 -- 172.21.15.110:0/3718741592 shutdown_connections 2024-08-17T02:32:42.115 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.112+0000 7fd08a600640 1 -- 172.21.15.110:0/3718741592 wait complete. 2024-08-17T02:32:42.116 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.114+0000 7fd08a600640 1 Processor -- start 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.114+0000 7fd08a600640 1 -- start start 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd084159130 0x7fd084155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08415cb30 0x7fd08415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd084157390 con 0x7fd084158d60 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd084156780 con 0x7fd084159130 2024-08-17T02:32:42.117 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd08a600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd084156a60 con 0x7fd08415cb30 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50140/0 (socket says 172.21.15.110:50140) 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 -- 172.21.15.110:0/964544354 learned_addr learned my addr 172.21.15.110:0/964544354 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd082a00640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd084159130 0x7fd084155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083e00640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08415cb30 0x7fd08415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 -- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08415cb30 msgr2=0x7fd08415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.118 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08415cb30 0x7fd08415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 -- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd084159130 msgr2=0x7fd084155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd084159130 0x7fd084155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.119 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.115+0000 7fd083400640 1 -- 172.21.15.110:0/964544354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009390 con 0x7fd084158d60 2024-08-17T02:32:42.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd083400640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c590 tx=0x7fd074007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.120 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074005aa0 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd074005c20 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740070f0 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd084156d40 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.116+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd084151a20 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.117+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd084064db0 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.118+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd074007540 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.119+0000 7fd07aa00640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 0x7fd064067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.119+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd074081240 con 0x7fd084158d60 2024-08-17T02:32:42.121 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.119+0000 7fd082a00640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 0x7fd064067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.122 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.120+0000 7fd082a00640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 0x7fd064067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd070034000 tx=0x7fd070032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.124 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.123+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd07404f630 con 0x7fd084158d60 2024-08-17T02:32:42.295 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.294+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0841571c0 con 0x7fd064065150 2024-08-17T02:32:42.296 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.295+0000 7fd07aa00640 1 -- 172.21.15.110:0/964544354 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd070032770 con 0x7fd064065150 2024-08-17T02:32:42.296 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:32:42.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 msgr2=0x7fd064067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.298 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 0x7fd064067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd070034000 tx=0x7fd070032000 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 msgr2=0x7fd0841514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd07400c590 tx=0x7fd074007ee0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 shutdown_connections 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fd064065150 0x7fd064067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08415cb30 0x7fd08415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd084159130 0x7fd084155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 --2- 172.21.15.110:0/964544354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd084158d60 0x7fd0841514e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 >> 172.21.15.110:0/964544354 conn(0x7fd0840b3040 msgr2=0x7fd084152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.299 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 shutdown_connections 2024-08-17T02:32:42.300 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.297+0000 7fd08a600640 1 -- 172.21.15.110:0/964544354 wait complete. 2024-08-17T02:32:42.313 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:32:42.313 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:42.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.464+0000 7fc510800640 1 Processor -- start 2024-08-17T02:32:42.465 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.464+0000 7fc510800640 1 -- start start 2024-08-17T02:32:42.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.465+0000 7fc510800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc508156d40 0x7fc50806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.465+0000 7fc510800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc50806e420 0x7fc5080ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.467 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.465+0000 7fc510800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50806e880 con 0x7fc508150130 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.465+0000 7fc510800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5081568b0 con 0x7fc508156d40 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.465+0000 7fc510800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508150500 con 0x7fc50806e420 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc508156d40 0x7fc50806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc508156d40 0x7fc50806dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50152/0 (socket says 172.21.15.110:50152) 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 -- 172.21.15.110:0/2562303564 learned_addr learned my addr 172.21.15.110:0/2562303564 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50e800640 1 --2- 172.21.15.110:0/2562303564 >> v2:172.21.15.177:3300/0 conn(0x7fc50806e420 0x7fc5080ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.468 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 -- 172.21.15.110:0/2562303564 >> v2:172.21.15.177:3300/0 conn(0x7fc50806e420 msgr2=0x7fc5080ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 --2- 172.21.15.110:0/2562303564 >> v2:172.21.15.177:3300/0 conn(0x7fc50806e420 0x7fc5080ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 -- 172.21.15.110:0/2562303564 >> v1:172.21.15.177:6789/0 conn(0x7fc508150130 legacy=0x7fc5080aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.469 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.466+0000 7fc50d400640 1 -- 172.21.15.110:0/2562303564 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508155fc0 con 0x7fc508156d40 2024-08-17T02:32:42.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.467+0000 7fc50d400640 1 --2- 172.21.15.110:0/2562303564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc50806dee0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc508068140 tx=0x7fc4f80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974067672d8a411c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.467+0000 7fc50ca00640 1 -- 172.21.15.110:0/2562303564 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f802ad50 con 0x7fc508156d40 2024-08-17T02:32:42.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.467+0000 7fc50ca00640 1 -- 172.21.15.110:0/2562303564 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8032440 con 0x7fc508156d40 2024-08-17T02:32:42.470 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.467+0000 7fc50ca00640 1 -- 172.21.15.110:0/2562303564 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8032820 con 0x7fc508156d40 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 -- 172.21.15.110:0/2562303564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 msgr2=0x7fc50806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 --2- 172.21.15.110:0/2562303564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc50806dee0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc508068140 tx=0x7fc4f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 -- 172.21.15.110:0/2562303564 shutdown_connections 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 --2- 172.21.15.110:0/2562303564 >> v2:172.21.15.177:3300/0 conn(0x7fc50806e420 0x7fc5080ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 --2- 172.21.15.110:0/2562303564 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc50806dee0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 -- 172.21.15.110:0/2562303564 >> 172.21.15.110:0/2562303564 conn(0x7fc508067750 msgr2=0x7fc50806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 -- 172.21.15.110:0/2562303564 shutdown_connections 2024-08-17T02:32:42.471 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.468+0000 7fc510800640 1 -- 172.21.15.110:0/2562303564 wait complete. 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.470+0000 7fc510800640 1 Processor -- start 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.470+0000 7fc510800640 1 -- start start 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50806e420 0x7fc50813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc508150130 0x7fc5081626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc508168070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508166d80 con 0x7fc508156d40 2024-08-17T02:32:42.474 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508162bf0 con 0x7fc508150130 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc510800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc508166170 con 0x7fc50806e420 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc50e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc508168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc50e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc508168070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50168/0 (socket says 172.21.15.110:50168) 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc50e800640 1 -- 172.21.15.110:0/2132149262 learned_addr learned my addr 172.21.15.110:0/2132149262 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc50de00640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50806e420 0x7fc50813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.471+0000 7fc50d400640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc508150130 0x7fc5081626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 -- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50806e420 msgr2=0x7fc50813bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc50806e420 0x7fc50813bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.475 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 -- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc508150130 msgr2=0x7fc5081626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc508150130 0x7fc5081626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f8009450 con 0x7fc508156d40 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc50e800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc508168070 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc504009fd0 tx=0x7fc504009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400ee90 con 0x7fc508156d40 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc504014420 con 0x7fc508156d40 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5040147e0 con 0x7fc508156d40 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc508166450 con 0x7fc508156d40 2024-08-17T02:32:42.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.472+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc508166a10 con 0x7fc508156d40 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.473+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5080710c0 con 0x7fc508156d40 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.474+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc504014b50 con 0x7fc508156d40 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc501600640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4ec065150 0x7fc4ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc5040828f0 con 0x7fc508156d40 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc501600640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7fc4ec06b040 0x7fc4ec06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4ec06db00 con 0x7fc4ec06b040 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc50de00640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4ec065150 0x7fc4ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.478 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc504087220 con 0x7fc508156d40 2024-08-17T02:32:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.475+0000 7fc50d400640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7fc4ec06b040 0x7fc4ec06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.476+0000 7fc50de00640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4ec065150 0x7fc4ec067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc007fd0 tx=0x7fc4fc007e10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.476+0000 7fc50d400640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7fc4ec06b040 0x7fc4ec06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.477+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== osd.6 v2:172.21.15.177:6822/37518 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fc4ec06db00 con 0x7fc4ec06b040 2024-08-17T02:32:42.491 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.490+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 --> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc508068ea0 con 0x7fc4ec06b040 2024-08-17T02:32:42.492 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc501600640 1 -- 172.21.15.110:0/2132149262 <== osd.6 v2:172.21.15.177:6822/37518 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc508068ea0 con 0x7fc4ec06b040 2024-08-17T02:32:42.492 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:42.493 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7fc4ec06b040 msgr2=0x7fc4ec06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.177:6822/37518,v1:172.21.15.177:6824/37518] conn(0x7fc4ec06b040 0x7fc4ec06d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4ec065150 msgr2=0x7fc4ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc4ec065150 0x7fc4ec067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc007fd0 tx=0x7fc4fc007e10 comp rx=0 tx=0).stop 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 msgr2=0x7fc508168070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 --2- 172.21.15.110:0/2132149262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc508156d40 0x7fc508168070 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc504009fd0 tx=0x7fc504009900 comp rx=0 tx=0).stop 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc50e800640 1 -- 172.21.15.110:0/2132149262 reap_dead start 2024-08-17T02:32:42.494 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 shutdown_connections 2024-08-17T02:32:42.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.491+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 >> 172.21.15.110:0/2132149262 conn(0x7fc508067750 msgr2=0x7fc50814f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.492+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 shutdown_connections 2024-08-17T02:32:42.495 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.492+0000 7fc510800640 1 -- 172.21.15.110:0/2132149262 wait complete. 2024-08-17T02:32:42.506 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:32:42.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.655+0000 7f916f600640 1 Processor -- start 2024-08-17T02:32:42.657 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.655+0000 7f916f600640 1 -- start start 2024-08-17T02:32:42.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.656+0000 7f916f600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f91681401b0 0x7f91680caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91680c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916f600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91680caa80 con 0x7f9168140580 2024-08-17T02:32:42.658 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916f600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91680cb450 con 0x7f91681401b0 2024-08-17T02:32:42.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680c9e70 con 0x7f91680b1440 2024-08-17T02:32:42.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f9167e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9168140580 0x7f91680b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46342/0 (socket says 172.21.15.110:46342) 2024-08-17T02:32:42.659 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f9167e00640 1 -- 172.21.15.110:0/3534709774 learned_addr learned my addr 172.21.15.110:0/3534709774 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:42.661 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916d600640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91680c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f916cc00640 1 --2- 172.21.15.110:0/3534709774 >> v2:172.21.15.177:3300/0 conn(0x7f91681401b0 0x7f91680caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263253747 0 0) 0x7f91680caa80 con 0x7f9168140580 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.657+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91500034e0 con 0x7f9168140580 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983032876 0 0) 0x7f91500034e0 con 0x7f9168140580 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 msgr2=0x7f91680c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.662 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91680c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 >> v2:172.21.15.177:3300/0 conn(0x7f91681401b0 msgr2=0x7f91680caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 --2- 172.21.15.110:0/3534709774 >> v2:172.21.15.177:3300/0 conn(0x7f91681401b0 0x7f91680caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680ca150 con 0x7f9168140580 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f9154001470 con 0x7f9168140580 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 >> v1:172.21.15.110:6789/0 conn(0x7f9168140580 legacy=0x7f91680b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91500039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f9150004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.663 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9150004cc0 0x7f9150005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680cb450 con 0x7f9150003f50 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680c9e70 con 0x7f9150004cc0 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915000ba00 con 0x7f91680b1440 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f9150004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f916cc00640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91500039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f916d600640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9150004cc0 0x7f9150005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 -- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 msgr2=0x7f91500039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.664 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680b1440 0x7f91500039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 -- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9150004cc0 msgr2=0x7f9150005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9150004cc0 0x7f9150005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f9167e00640 1 -- 172.21.15.110:0/3534709774 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500034e0 con 0x7f9150003f50 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.658+0000 7f916d600640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9150004cc0 0x7f9150005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.659+0000 7f9167e00640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f9150004780 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f915400c2a0 tx=0x7f9154001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26628d5186ce38bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005890 con 0x7f9150003f50 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154005a30 con 0x7f9150003f50 2024-08-17T02:32:42.665 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f9167400640 1 -- 172.21.15.110:0/3534709774 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154005e70 con 0x7f9150003f50 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 -- 172.21.15.110:0/3534709774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 msgr2=0x7f9150004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 --2- 172.21.15.110:0/3534709774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f9150004780 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f915400c2a0 tx=0x7f9154001e90 comp rx=0 tx=0).stop 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916d600640 1 -- 172.21.15.110:0/3534709774 reap_dead start 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 -- 172.21.15.110:0/3534709774 shutdown_connections 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 -- 172.21.15.110:0/3534709774 >> 172.21.15.110:0/3534709774 conn(0x7f91680cb9b0 msgr2=0x7f91680cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 -- 172.21.15.110:0/3534709774 shutdown_connections 2024-08-17T02:32:42.666 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.660+0000 7f916f600640 1 -- 172.21.15.110:0/3534709774 wait complete. 2024-08-17T02:32:42.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.662+0000 7f916f600640 1 Processor -- start 2024-08-17T02:32:42.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.662+0000 7f916f600640 1 -- start start 2024-08-17T02:32:42.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.669 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680abe90 0x7f9168135650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9168132d80 0x7f91680c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680a8860 con 0x7f9150003f50 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91680a8230 con 0x7f9168132d80 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91680ac340 con 0x7f91680abe90 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50180/0 (socket says 172.21.15.110:50180) 2024-08-17T02:32:42.670 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 -- 172.21.15.110:0/2920504380 learned_addr learned my addr 172.21.15.110:0/2920504380 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f9167e00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680abe90 0x7f9168135650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916d600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9168132d80 0x7f91680c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 -- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680abe90 msgr2=0x7f9168135650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680abe90 0x7f9168135650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 -- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9168132d80 msgr2=0x7f91680c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9168132d80 0x7f91680c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.663+0000 7f916cc00640 1 -- 172.21.15.110:0/2920504380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91680ac620 con 0x7f9150003f50 2024-08-17T02:32:42.671 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f916cc00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f915c011b40 tx=0x7f915c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c00fa80 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915c00fbe0 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c014440 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91680a84f0 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.664+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9168135b90 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.665+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9168064db0 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.666+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f915c0147f0 con 0x7f9150003f50 2024-08-17T02:32:42.672 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.667+0000 7f915be00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 0x7f9148067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:42.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.667+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f915c018030 con 0x7f9150003f50 2024-08-17T02:32:42.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.667+0000 7f9167e00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 0x7f9148067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:42.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.668+0000 7f9167e00640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 0x7f9148067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9154033000 tx=0x7f9154034000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:42.673 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.671+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f915c0549f0 con 0x7f9150003f50 2024-08-17T02:32:42.842 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.841+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f91680ac7b0 con 0x7f9148065180 2024-08-17T02:32:42.843 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.842+0000 7f915be00640 1 -- 172.21.15.110:0/2920504380 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f91680ac7b0 con 0x7f9148065180 2024-08-17T02:32:42.843 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:32:42.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 msgr2=0x7f9148067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.845 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 0x7f9148067630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9154033000 tx=0x7f9154034000 comp rx=0 tx=0).stop 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 msgr2=0x7f91680c0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f915c011b40 tx=0x7f915c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 shutdown_connections 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9148065180 0x7f9148067630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9168132d80 0x7f91680c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91680abe90 0x7f9168135650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.846 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 --2- 172.21.15.110:0/2920504380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9150003f50 0x7f91680c0a10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:42.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 >> 172.21.15.110:0/2920504380 conn(0x7f91680cb9b0 msgr2=0x7f916806dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:42.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 shutdown_connections 2024-08-17T02:32:42.847 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:42.844+0000 7f916f600640 1 -- 172.21.15.110:0/2920504380 wait complete. 2024-08-17T02:32:42.861 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:32:42.861 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:32:43.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 Processor -- start 2024-08-17T02:32:43.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 -- start start 2024-08-17T02:32:43.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 0x7fcfd00aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.014 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfd00ab120 0x7fcfd0068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00ac4e0 con 0x7fcfd00685c0 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00ac780 con 0x7fcfd00ab120 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.012+0000 7fcfd5c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd00aca60 con 0x7fcfd00aa810 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfd00ab120 0x7fcfd0068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfd00ab120 0x7fcfd0068080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50194/0 (socket says 172.21.15.110:50194) 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 -- 172.21.15.110:0/1259739026 learned_addr learned my addr 172.21.15.110:0/1259739026 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:43.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfcea00640 1 --2- 172.21.15.110:0/1259739026 >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 0x7fcfd00aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 -- 172.21.15.110:0/1259739026 >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 msgr2=0x7fcfd00aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 --2- 172.21.15.110:0/1259739026 >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 0x7fcfd00aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 -- 172.21.15.110:0/1259739026 >> v1:172.21.15.177:6789/0 conn(0x7fcfd00685c0 legacy=0x7fcfd00689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfce000640 1 -- 172.21.15.110:0/1259739026 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd00acd40 con 0x7fcfd00ab120 2024-08-17T02:32:43.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.013+0000 7fcfcea00640 1 --2- 172.21.15.110:0/1259739026 >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 0x7fcfd00aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:32:43.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.014+0000 7fcfce000640 1 --2- 172.21.15.110:0/1259739026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd0068080 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcfd005ec00 tx=0x7fcfbc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc88f0df130458c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.014+0000 7fcfcd600640 1 -- 172.21.15.110:0/1259739026 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc02add0 con 0x7fcfd00ab120 2024-08-17T02:32:43.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.014+0000 7fcfcd600640 1 -- 172.21.15.110:0/1259739026 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc032440 con 0x7fcfd00ab120 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.014+0000 7fcfcd600640 1 -- 172.21.15.110:0/1259739026 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc032820 con 0x7fcfd00ab120 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 -- 172.21.15.110:0/1259739026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 msgr2=0x7fcfd0068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/1259739026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd0068080 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcfd005ec00 tx=0x7fcfbc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 -- 172.21.15.110:0/1259739026 shutdown_connections 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/1259739026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd0068080 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/1259739026 >> v2:172.21.15.177:3300/0 conn(0x7fcfd00aa810 0x7fcfd00aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 -- 172.21.15.110:0/1259739026 >> 172.21.15.110:0/1259739026 conn(0x7fcfd0096a70 msgr2=0x7fcfd0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 -- 172.21.15.110:0/1259739026 shutdown_connections 2024-08-17T02:32:43.019 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.015+0000 7fcfd5c00640 1 -- 172.21.15.110:0/1259739026 wait complete. 2024-08-17T02:32:43.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.016+0000 7fcfd5c00640 1 Processor -- start 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.016+0000 7fcfd5c00640 1 -- start start 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcfd00685c0 0x7fcfd01523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd00aa810 0x7fcfd00b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd013f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0158240 con 0x7fcfd00ab120 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0152910 con 0x7fcfd00aa810 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfd5c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0153830 con 0x7fcfd00685c0 2024-08-17T02:32:43.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.017+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd013f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50196/0 (socket says 172.21.15.110:50196) 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 -- 172.21.15.110:0/2911067368 learned_addr learned my addr 172.21.15.110:0/2911067368 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcea00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcfd00685c0 0x7fcfd01523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfce000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd00aa810 0x7fcfd00b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 -- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcfd00685c0 msgr2=0x7fcfd01523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcfd00685c0 0x7fcfd01523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 -- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd00aa810 msgr2=0x7fcfd00b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd00aa810 0x7fcfd00b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc009450 con 0x7fcfd00ab120 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfce000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcfd00aa810 0x7fcfd00b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfcf400640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd013f270 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c890 tx=0x7fcfc8002640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800ce80 con 0x7fcfd00ab120 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800a880 con 0x7fcfd00ab120 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800ac80 con 0x7fcfd00ab120 2024-08-17T02:32:43.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.018+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0153b10 con 0x7fcfd00ab120 2024-08-17T02:32:43.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.019+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd01540d0 con 0x7fcfd00ab120 2024-08-17T02:32:43.024 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.019+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfd00710c0 con 0x7fcfd00ab120 2024-08-17T02:32:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.020+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcfc8012630 con 0x7fcfd00ab120 2024-08-17T02:32:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfc6000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfb0065150 0x7fcfb0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fcfc80825c0 con 0x7fcfd00ab120 2024-08-17T02:32:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfc6000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fcfb006b040 0x7fcfb006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.025 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfcea00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfb0065150 0x7fcfb0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfb006db00 con 0x7fcfb006b040 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.021+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8084ac0 con 0x7fcfd00ab120 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.022+0000 7fcfce000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fcfb006b040 0x7fcfb006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.022+0000 7fcfcea00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfb0065150 0x7fcfb0067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000acc0 tx=0x7fcfc0008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.022+0000 7fcfce000640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fcfb006b040 0x7fcfb006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.026 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.023+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== osd.7 v2:172.21.15.177:6816/37517 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fcfb006db00 con 0x7fcfb006b040 2024-08-17T02:32:43.037 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.036+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 --> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcfd01542c0 con 0x7fcfb006b040 2024-08-17T02:32:43.038 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfc6000640 1 -- 172.21.15.110:0/2911067368 <== osd.7 v2:172.21.15.177:6816/37517 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcfd01542c0 con 0x7fcfb006b040 2024-08-17T02:32:43.038 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-08-17T02:32:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:32:43.039 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fcfb006b040 msgr2=0x7fcfb006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.177:6816/37517,v1:172.21.15.177:6817/37517] conn(0x7fcfb006b040 0x7fcfb006d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfb0065150 msgr2=0x7fcfb0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fcfb0065150 0x7fcfb0067600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000acc0 tx=0x7fcfc0008040 comp rx=0 tx=0).stop 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 msgr2=0x7fcfd013f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 --2- 172.21.15.110:0/2911067368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfd00ab120 0x7fcfd013f270 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c890 tx=0x7fcfc8002640 comp rx=0 tx=0).stop 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfcf400640 1 -- 172.21.15.110:0/2911067368 reap_dead start 2024-08-17T02:32:43.040 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 shutdown_connections 2024-08-17T02:32:43.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 >> 172.21.15.110:0/2911067368 conn(0x7fcfd0096a70 msgr2=0x7fcfd00af010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 shutdown_connections 2024-08-17T02:32:43.041 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.038+0000 7fcfd5c00640 1 -- 172.21.15.110:0/2911067368 wait complete. 2024-08-17T02:32:43.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:32:43.201 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.201+0000 7f949a400640 1 Processor -- start 2024-08-17T02:32:43.202 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.201+0000 7f949a400640 1 -- start start 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.202+0000 7f949a400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f94940aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.202+0000 7f949a400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9494155550 0x7f94940ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.202+0000 7f949a400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94940afc10 con 0x7f949406e080 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.202+0000 7f949a400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94940ae5b0 con 0x7f9494155550 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.202+0000 7f949a400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94940af000 con 0x7f9494155180 2024-08-17T02:32:43.203 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9493e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f949406e080 0x7f949406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46354/0 (socket says 172.21.15.110:46354) 2024-08-17T02:32:43.204 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9493e00640 1 -- 172.21.15.110:0/3802942641 learned_addr learned my addr 172.21.15.110:0/3802942641 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:32:43.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f948aa00640 1 --2- 172.21.15.110:0/3802942641 >> v2:172.21.15.177:3300/0 conn(0x7f9494155550 0x7f94940ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9493400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f94940aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.205 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347191832 0 0) 0x7f94940afc10 con 0x7f949406e080 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94780034e0 con 0x7f949406e080 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.203+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038642863 0 0) 0x7f94780034e0 con 0x7f949406e080 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 msgr2=0x7f94940aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f94940aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 >> v2:172.21.15.177:3300/0 conn(0x7f9494155550 msgr2=0x7f94940ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 --2- 172.21.15.110:0/3802942641 >> v2:172.21.15.177:3300/0 conn(0x7f9494155550 0x7f94940ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94940af2e0 con 0x7f949406e080 2024-08-17T02:32:43.206 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3909966308 0 0) 0x7f948c001810 con 0x7f949406e080 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 >> v1:172.21.15.110:6789/0 conn(0x7f949406e080 legacy=0x7f949406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9478003a50 0x7f9478003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f9478004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9478004cc0 0x7f9478005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940ae5b0 con 0x7f9478003a50 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940af000 con 0x7f9478004cc0 2024-08-17T02:32:43.207 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947800ba80 con 0x7f9494155180 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9478003a50 0x7f9478003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f948aa00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f9478004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493e00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9478004cc0 0x7f9478005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 -- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 msgr2=0x7f9478004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9494155180 0x7f9478004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 -- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9478004cc0 msgr2=0x7f9478005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.210 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9478004cc0 0x7f9478005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493400640 1 -- 172.21.15.110:0/3802942641 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94780034e0 con 0x7f9478003a50 2024-08-17T02:32:43.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.204+0000 7f9493e00640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9478004cc0 0x7f9478005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:43.211 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.205+0000 7f9493400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9478003a50 0x7f9478003e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9484009ba0 tx=0x7f94840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bc1d00ad3a05b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.205+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484031400 con 0x7f9478003a50 2024-08-17T02:32:43.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.205+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948402d050 con 0x7f9478003a50 2024-08-17T02:32:43.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.205+0000 7f9492a00640 1 -- 172.21.15.110:0/3802942641 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484031790 con 0x7f9478003a50 2024-08-17T02:32:43.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 -- 172.21.15.110:0/3802942641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9478003a50 msgr2=0x7f9478003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.214 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 --2- 172.21.15.110:0/3802942641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9478003a50 0x7f9478003e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9484009ba0 tx=0x7f94840090f0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f9493e00640 1 -- 172.21.15.110:0/3802942641 reap_dead start 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 -- 172.21.15.110:0/3802942641 shutdown_connections 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 -- 172.21.15.110:0/3802942641 >> 172.21.15.110:0/3802942641 conn(0x7f94940cb9b0 msgr2=0x7f94940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 -- 172.21.15.110:0/3802942641 shutdown_connections 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.206+0000 7f949a400640 1 -- 172.21.15.110:0/3802942641 wait complete. 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.207+0000 7f949a400640 1 Processor -- start 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 -- start start 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 0x7f949414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.215 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9494147f00 0x7f949414cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949414cca0 con 0x7f9494147a90 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949414c2d0 con 0x7f9494147f00 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.208+0000 7f949a400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949414a5b0 con 0x7f9478003a50 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50202/0 (socket says 172.21.15.110:50202) 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 -- 172.21.15.110:0/1115863195 learned_addr learned my addr 172.21.15.110:0/1115863195 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f9493400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 0x7f949414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.216 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f9493e00640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9494147f00 0x7f949414cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 -- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 msgr2=0x7f949414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 0x7f949414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 -- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9494147f00 msgr2=0x7f949414cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9494147f00 0x7f949414cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 -- 172.21.15.110:0/1115863195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949414b6c0 con 0x7f9494147a90 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f9493400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 0x7f949414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.209+0000 7f948aa00640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f947c011990 tx=0x7f947c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.210+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c009e40 con 0x7f9494147a90 2024-08-17T02:32:43.217 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.210+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00f9d0 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.210+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00fd90 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.210+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949414b9a0 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.210+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949414bf60 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.211+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494064db0 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.211+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f947c015670 con 0x7f9494147a90 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.212+0000 7f948b400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 0x7f9470067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.218 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.212+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f947c0828e0 con 0x7f9494147a90 2024-08-17T02:32:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.212+0000 7f9493400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 0x7f9470067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.213+0000 7f9493400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 0x7f9470067630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9484009ba0 tx=0x7f9484035000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.219 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.217+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f947c050ba0 con 0x7f9494147a90 2024-08-17T02:32:43.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.389+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f949414c410 con 0x7f9470065180 2024-08-17T02:32:43.390 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.390+0000 7f948b400640 1 -- 172.21.15.110:0/1115863195 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f949414c410 con 0x7f9470065180 2024-08-17T02:32:43.390 INFO:teuthology.orchestra.run.smithi110.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:32:43.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 msgr2=0x7f9470067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 0x7f9470067630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9484009ba0 tx=0x7f9484035000 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 msgr2=0x7f949414ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f947c011990 tx=0x7f947c008040 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 shutdown_connections 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f9470065180 0x7f9470067630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9494147f00 0x7f949414cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9494147a90 0x7f949414ac00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 --2- 172.21.15.110:0/1115863195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9478003a50 0x7f949414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 >> 172.21.15.110:0/1115863195 conn(0x7f94940cb9b0 msgr2=0x7f94941530c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 shutdown_connections 2024-08-17T02:32:43.394 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.392+0000 7f949a400640 1 -- 172.21.15.110:0/1115863195 wait complete. 2024-08-17T02:32:43.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:32:43.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.554+0000 7f873d400640 1 Processor -- start 2024-08-17T02:32:43.555 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.554+0000 7f873d400640 1 -- start start 2024-08-17T02:32:43.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f873d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f873806df00 0x7f87380adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.556 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f873d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155df0 0x7f87380ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f873d400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8738156670 con 0x7f8738155a20 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f873d400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380b0350 con 0x7f873806df00 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f873d400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873806e5e0 con 0x7f8738155df0 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f8735e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f873806df00 0x7f87380adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f8735e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f873806df00 0x7f87380adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50206/0 (socket says 172.21.15.110:50206) 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f8735e00640 1 -- 172.21.15.110:0/2198504200 learned_addr learned my addr 172.21.15.110:0/2198504200 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f8736800640 1 --1- 172.21.15.110:0/2198504200 >> v1:172.21.15.110:6789/0 conn(0x7f8738155a20 0x7f873806d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:46364/0 (socket says 172.21.15.110:46364) 2024-08-17T02:32:43.557 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.556+0000 7f8737200640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155df0 0x7f87380ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.557+0000 7f8735e00640 1 -- 172.21.15.110:0/2198504200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155df0 msgr2=0x7f87380ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:32:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.557+0000 7f8735e00640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155df0 0x7f87380ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.557+0000 7f8735e00640 1 -- 172.21.15.110:0/2198504200 >> v1:172.21.15.110:6789/0 conn(0x7f8738155a20 legacy=0x7f873806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.557+0000 7f8735e00640 1 -- 172.21.15.110:0/2198504200 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873806e8c0 con 0x7f873806df00 2024-08-17T02:32:43.558 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.558+0000 7f8735e00640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f87380adf10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8724009910 tx=0x7f87240091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485278e19bb3a677 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.559 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.558+0000 7f8735400640 1 -- 172.21.15.110:0/2198504200 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872402ae40 con 0x7f873806df00 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.558+0000 7f8735400640 1 -- 172.21.15.110:0/2198504200 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724032440 con 0x7f873806df00 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.558+0000 7f8735400640 1 -- 172.21.15.110:0/2198504200 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724032820 con 0x7f873806df00 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 -- 172.21.15.110:0/2198504200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 msgr2=0x7f87380adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f87380adf10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8724009910 tx=0x7f87240091d0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 -- 172.21.15.110:0/2198504200 shutdown_connections 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155df0 0x7f87380ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 --2- 172.21.15.110:0/2198504200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f87380adf10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.560 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 -- 172.21.15.110:0/2198504200 >> 172.21.15.110:0/2198504200 conn(0x7f87380cb9b0 msgr2=0x7f87380cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 -- 172.21.15.110:0/2198504200 shutdown_connections 2024-08-17T02:32:43.561 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.559+0000 7f873d400640 1 -- 172.21.15.110:0/2198504200 wait complete. 2024-08-17T02:32:43.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.560+0000 7f873d400640 1 Processor -- start 2024-08-17T02:32:43.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.560+0000 7f873d400640 1 -- start start 2024-08-17T02:32:43.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155a20 0x7f873813a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.563 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 0x7f873814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873813a950 con 0x7f873806df00 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873814e120 con 0x7f8738155df0 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f873d400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8738169330 con 0x7f8738155a20 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.561+0000 7f8736800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:50224/0 (socket says 172.21.15.110:50224) 2024-08-17T02:32:43.564 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 -- 172.21.15.110:0/2408011652 learned_addr learned my addr 172.21.15.110:0/2408011652 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8735e00640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155a20 0x7f873813a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8737200640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 0x7f873814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 -- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155a20 msgr2=0x7f873813a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155a20 0x7f873813a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 -- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 msgr2=0x7f873814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 0x7f873814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 -- 172.21.15.110:0/2408011652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009450 con 0x7f873806df00 2024-08-17T02:32:43.565 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8737200640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 0x7f873814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f8736800640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f872800c5c0 tx=0x7f8728007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728007300 con 0x7f873806df00 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728007460 con 0x7f873806df00 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280047a0 con 0x7f873806df00 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.562+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8738169610 con 0x7f873806df00 2024-08-17T02:32:43.566 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.563+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8738169bd0 con 0x7f873806df00 2024-08-17T02:32:43.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.564+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8738064db0 con 0x7f873806df00 2024-08-17T02:32:43.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.564+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8728004bb0 con 0x7f873806df00 2024-08-17T02:32:43.567 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.565+0000 7f872e000640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 0x7f8718067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:32:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.565+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f87280811c0 con 0x7f873806df00 2024-08-17T02:32:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.565+0000 7f8735e00640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 0x7f8718067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:32:43.568 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.566+0000 7f8735e00640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 0x7f8718067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8724034000 tx=0x7f8724032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:32:43.569 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.569+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f872804f500 con 0x7f873806df00 2024-08-17T02:32:43.740 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.739+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f873814e260 con 0x7f8718065150 2024-08-17T02:32:43.742 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.741+0000 7f872e000640 1 -- 172.21.15.110:0/2408011652 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50729 (secure 0 0 0) 0x7f8724032770 con 0x7f8718065150 2024-08-17T02:32:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:32:43.743 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:32:43.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.743+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 msgr2=0x7f8718067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.746 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.743+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 0x7f8718067600 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8724034000 tx=0x7f8724032000 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.743+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 msgr2=0x7f8738168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.743+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f872800c5c0 tx=0x7f8728007ee0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 shutdown_connections 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f8718065150 0x7f8718067600 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8738155df0 0x7f873814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8738155a20 0x7f873813a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 --2- 172.21.15.110:0/2408011652 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f873806df00 0x7f8738168ce0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:32:43.747 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 >> 172.21.15.110:0/2408011652 conn(0x7f87380cb9b0 msgr2=0x7f87381484c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:32:43.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 shutdown_connections 2024-08-17T02:32:43.748 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:32:43.744+0000 7f873d400640 1 -- 172.21.15.110:0/2408011652 wait complete. 2024-08-17T02:32:43.758 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-08-17T02:32:43.491286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404880,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569840,"statfs":{"total":773094113280,"available":770631516160,"internally_reserved":0,"allocated":5349376,"data_stored":2906752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.248013"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":182,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:32:33.210292+0000","last_change":"2024-08-17T02:29:06.113625+0000","last_active":"2024-08-17T02:32:33.210292+0000","last_peered":"2024-08-17T02:32:33.210292+0000","last_clean":"2024-08-17T02:32:33.210292+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:32:33.210292+0000","last_undegraded":"2024-08-17T02:32:33.210292+0000","last_fullsized":"2024-08-17T02:32:33.210292+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:29:04.114749+0000","last_clean_scrub_stamp":"2024-08-17T02:29:04.114749+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:32:36.802339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298448,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073392,"statfs":{"total":96636764160,"available":96331153408,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.46899999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.627,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.45,"15min":1.45},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92300000000000004,"5min":1.014,"15min":1.014},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90300000000000002,"5min":1.151,"15min":1.151},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.54900000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88400000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.67800000000000005}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64400000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.343,"15min":1.343},"last":0.436},{"interface":"front","average":{"1min":0.746,"5min":0.63800000000000001,"15min":0.60999999999999999},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.62,"5min":0.434,"15min":0.434},"max":{"1min":0.90800000000000003,"5min":1.371,"15min":1.371},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.70799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.621,"5min":0.503,"15min":0.503},"max":{"1min":0.90800000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.66600000000000004},"min":{"1min":0.57599999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.411,"15min":1.411},"last":0.60899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63300000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":0.997,"15min":0.997},"last":0.747}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.872,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77100000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.57599999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89600000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.68500000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.83399999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59799999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80400000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66500000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":1.173,"15min":1.173},"last":0.746},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.76900000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.81799999999999995,"15min":0.86899999999999999},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.60199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78700000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91900000000000004,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92200000000000004,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.873}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.65600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.66400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90900000000000003,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.60599999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77300000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":1.55,"15min":1.55},"last":0.79600000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64900000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":1.024,"15min":1.024},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.62,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.374},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75900000000000001,"5min":1.099,"15min":1.099},"last":0.496}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.044,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.64400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.248,"15min":1.248},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.022,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98599999999999999,"5min":1.236,"15min":1.236},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.755},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81200000000000006},"min":{"1min":0.629,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96799999999999997,"5min":1.377,"15min":1.377},"last":0.78900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64200000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.58599999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99399999999999999,"5min":1.29,"15min":1.29},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.89000000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.55400000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.93799999999999994,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96299999999999997,"5min":1.319,"15min":1.319},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0329999999999999,"5min":1.143,"15min":1.143},"last":0.57499999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.012,"5min":1.389,"15min":1.389},"last":0.625},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97899999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.68700000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.442,"15min":0.45300000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.502}]},{"osd":3,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.48699999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.054,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95499999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.745},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.627}]},{"osd":6,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.755,"15min":0.754},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.024,"5min":1.03,"15min":1.03},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.64600000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94899999999999995,"5min":1.022,"15min":1.022},"last":0.59499999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.45200000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.505},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.54300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.374},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.53500000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.64200000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65900000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.754},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.56399999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.879}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.627,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:32:43.762 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:29:04.114749+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=29, tm_sec=4, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=32, tm_sec=38, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:32:43.762 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:32:44.864 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:32:44.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:33:03.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:33:03.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.921+0000 7fc3e3200640 1 Processor -- start 2024-08-17T02:33:03.922 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.921+0000 7fc3e3200640 1 -- start start 2024-08-17T02:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.922+0000 7fc3e3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 0x7fc3dc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.922+0000 7fc3e3200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3dc140580 0x7fc3dc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.922+0000 7fc3e3200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc0caa80 con 0x7fc3dc1401b0 2024-08-17T02:33:03.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e3200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc0cb450 con 0x7fc3dc140580 2024-08-17T02:33:03.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0c9e70 con 0x7fc3dc0b1440 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3dc140580 0x7fc3dc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3d3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 0x7fc3dc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3dc140580 0x7fc3dc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.110:42766/0 (socket says 172.21.15.110:42766) 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 -- 172.21.15.110:0/3342785254 learned_addr learned my addr 172.21.15.110:0/3342785254 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 -- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 msgr2=0x7fc3dc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:33:03.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 0x7fc3dc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.923+0000 7fc3e1200640 1 -- 172.21.15.110:0/3342785254 >> v1:172.21.15.177:6789/0 conn(0x7fc3dc1401b0 legacy=0x7fc3dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.924+0000 7fc3e1200640 1 -- 172.21.15.110:0/3342785254 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0ca150 con 0x7fc3dc140580 2024-08-17T02:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.924+0000 7fc3db400640 1 -- 172.21.15.110:0/3342785254 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482117706 0 0) 0x7fc3dc0caa80 con 0x7fc3dc1401b0 2024-08-17T02:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.924+0000 7fc3d3e00640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 0x7fc3dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:33:03.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3e1200640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc140580 0x7fc3dc0c9040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009f20 tx=0x7fc3d4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03eda469bdfedda server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:03.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3db400640 1 -- 172.21.15.110:0/3342785254 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4031400 con 0x7fc3dc140580 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3db400640 1 -- 172.21.15.110:0/3342785254 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d402d050 con 0x7fc3dc140580 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3db400640 1 -- 172.21.15.110:0/3342785254 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4031790 con 0x7fc3dc140580 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3e3200640 1 -- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc140580 msgr2=0x7fc3dc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.925+0000 7fc3e3200640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc140580 0x7fc3dc0c9040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009f20 tx=0x7fc3d4009840 comp rx=0 tx=0).stop 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 -- 172.21.15.110:0/3342785254 shutdown_connections 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc140580 0x7fc3dc0c9040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:03.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 --2- 172.21.15.110:0/3342785254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc0b1440 0x7fc3dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 -- 172.21.15.110:0/3342785254 >> 172.21.15.110:0/3342785254 conn(0x7fc3dc0cb9b0 msgr2=0x7fc3dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 -- 172.21.15.110:0/3342785254 shutdown_connections 2024-08-17T02:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.926+0000 7fc3e3200640 1 -- 172.21.15.110:0/3342785254 wait complete. 2024-08-17T02:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.927+0000 7fc3e3200640 1 Processor -- start 2024-08-17T02:33:03.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.927+0000 7fc3e3200640 1 -- start start 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc0b1440 0x7fc3dc158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 0x7fc3dc0b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc158e50 con 0x7fc3dc140580 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15a7d0 con 0x7fc3dc0b1440 2024-08-17T02:33:03.931 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15aab0 con 0x7fc3dc1401b0 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53808/0 (socket says 172.21.15.110:53808) 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.928+0000 7fc3e1200640 1 -- 172.21.15.110:0/1263233055 learned_addr learned my addr 172.21.15.110:0/1263233055 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3d3e00640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 0x7fc3dc0b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3dbe00640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc0b1440 0x7fc3dc158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 -- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 msgr2=0x7fc3dc0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 0x7fc3dc0b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:03.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 -- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc0b1440 msgr2=0x7fc3dc158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc0b1440 0x7fc3dc158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 -- 172.21.15.110:0/1263233055 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009390 con 0x7fc3dc140580 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3d3e00640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 0x7fc3dc0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e1200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009f20 tx=0x7fc3d4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4007760 con 0x7fc3dc140580 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d40078c0 con 0x7fc3dc140580 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4007c80 con 0x7fc3dc140580 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.929+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d4009ae0 con 0x7fc3dc140580 2024-08-17T02:33:03.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.930+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc15ae40 con 0x7fc3dc140580 2024-08-17T02:33:03.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.931+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc064db0 con 0x7fc3dc140580 2024-08-17T02:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.931+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc3d403c420 con 0x7fc3dc140580 2024-08-17T02:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.932+0000 7fc3d3400640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 0x7fc3b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.932+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc3d40a2f20 con 0x7fc3dc140580 2024-08-17T02:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.932+0000 7fc3dbe00640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 0x7fc3b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:03.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.933+0000 7fc3dbe00640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 0x7fc3b8067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0011e0 tx=0x7fc3cc007ca0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:03.937 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:03.937+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc3d4071330 con 0x7fc3dc140580 2024-08-17T02:33:04.106 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.106+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 --> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3dc06e5b0 con 0x7fc3b8065150 2024-08-17T02:33:04.108 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.108+0000 7fc3d3400640 1 -- 172.21.15.110:0/1263233055 <== mgr.4111 v2:172.21.15.110:6832/36835 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50808 (secure 0 0 0) 0x7fc3dc06e5b0 con 0x7fc3b8065150 2024-08-17T02:33:04.109 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:33:04.109 INFO:teuthology.orchestra.run.smithi110.stderr:dumped all 2024-08-17T02:33:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 msgr2=0x7fc3b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 0x7fc3b8067600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0011e0 tx=0x7fc3cc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 msgr2=0x7fc3dc13b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009f20 tx=0x7fc3d4036000 comp rx=0 tx=0).stop 2024-08-17T02:33:04.111 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 shutdown_connections 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7fc3b8065150 0x7fc3b8067600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3dc140580 0x7fc3dc13b500 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3dc1401b0 0x7fc3dc0b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 --2- 172.21.15.110:0/1263233055 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3dc0b1440 0x7fc3dc158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.110+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 >> 172.21.15.110:0/1263233055 conn(0x7fc3dc0cb9b0 msgr2=0x7fc3dc13c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.111+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 shutdown_connections 2024-08-17T02:33:04.112 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.111+0000 7fc3e3200640 1 -- 172.21.15.110:0/1263233055 wait complete. 2024-08-17T02:33:04.126 INFO:teuthology.orchestra.run.smithi110.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-08-17T02:33:03.496027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2404868,"kb_used_data":5224,"kb_used_omap":13,"kb_used_meta":2399538,"kb_avail":752569852,"statfs":{"total":773094113280,"available":770631528448,"internally_reserved":0,"allocated":5349376,"data_stored":2906752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2457127616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002664"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":195,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-08-17T02:32:45.255444+0000","last_change":"2024-08-17T02:32:45.255383+0000","last_active":"2024-08-17T02:32:45.255444+0000","last_peered":"2024-08-17T02:32:45.255444+0000","last_clean":"2024-08-17T02:32:45.255444+0000","last_became_active":"2024-08-17T02:29:06.112306+0000","last_became_peered":"2024-08-17T02:29:06.112306+0000","last_unstale":"2024-08-17T02:32:45.255444+0000","last_undegraded":"2024-08-17T02:32:45.255444+0000","last_fullsized":"2024-08-17T02:32:45.255444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2024-08-17T02:32:45.255254+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2024-08-17T02:32:45.255254+0000","last_clean_scrub_stamp":"2024-08-17T02:32:45.255254+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:03:11.373381+0000","scrub_duration":0.0058187760000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.628,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.91500000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.86399999999999999,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.71299999999999997,"15min":0.70299999999999996},"min":{"1min":0.627,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.84599999999999997,"5min":1.45,"15min":1.45},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.73899999999999999,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95799999999999996,"5min":1.464,"15min":1.464},"last":0.68999999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.72899999999999998,"15min":0.70699999999999996},"min":{"1min":0.55300000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92300000000000004,"5min":1.014,"15min":1.014},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.71899999999999997,"15min":0.70199999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90300000000000002,"5min":1.151,"15min":1.151},"last":0.70899999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.66000000000000003,"15min":0.628},"min":{"1min":0.54900000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.69899999999999995,"15min":0.68700000000000006},"min":{"1min":0.60499999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.88400000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61499999999999999,"15min":0.63300000000000001},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82499999999999996,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75900000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84599999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.505},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93300000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.51000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.88,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45200000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68600000000000005,"15min":0.66800000000000004},"min":{"1min":0.435,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89600000000000002,"5min":1.343,"15min":1.343},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.746,"5min":0.63800000000000001,"15min":0.60999999999999999},"min":{"1min":0.54300000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77200000000000002}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69099999999999995,"15min":0.68700000000000006},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.69999999999999996,"15min":0.68200000000000005},"min":{"1min":0.58999999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.877,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.62,"5min":0.434,"15min":0.434},"max":{"1min":0.90800000000000003,"5min":1.371,"15min":1.371},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.621,"5min":0.503,"15min":0.503},"max":{"1min":0.90800000000000003,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69599999999999995,"15min":0.66600000000000004},"min":{"1min":0.57599999999999996,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.411,"15min":1.411},"last":0.78900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.65400000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.877,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.51000000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92100000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.64000000000000001,"15min":0.63},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.67200000000000004,"15min":0.68000000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.95399999999999996,"5min":0.997,"15min":0.997},"last":0.55000000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.69599999999999995,"15min":0.70799999999999996},"min":{"1min":0.48599999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.872,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71199999999999997,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98299999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69799999999999995,"15min":0.68899999999999995},"min":{"1min":0.51300000000000001,"5min":0.443,"15min":0.443},"max":{"1min":0.92200000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73599999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.58099999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.872,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70099999999999996,"15min":0.68999999999999995},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85299999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75,"15min":0.74099999999999999},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.73999999999999999,"15min":0.72199999999999998},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.89600000000000002,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.70299999999999996,"15min":0.68700000000000006},"min":{"1min":0.55900000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.70299999999999996,"15min":0.68500000000000005},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79900000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.628,"15min":0.63},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83099999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.59899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.80400000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.73699999999999999},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86599999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.63200000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.752,"15min":0.76600000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.86299999999999999,"5min":1.173,"15min":1.173},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.54600000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.92900000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.70599999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.81799999999999995,"15min":0.86899999999999999},"min":{"1min":0.439,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":4.8170000000000002,"15min":4.8170000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.68700000000000006,"15min":0.67100000000000004},"min":{"1min":0.60199999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.84499999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70199999999999996,"15min":0.68999999999999995},"min":{"1min":0.56999999999999995,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91900000000000004,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92200000000000004,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.90900000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.53200000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.752},{"interface":"front","average":{"1min":0.755,"5min":0.70899999999999996,"15min":0.70099999999999996},"min":{"1min":0.58899999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.90000000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.94699999999999995}]},{"osd":3,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72399999999999998,"15min":0.71299999999999997},"min":{"1min":0.65600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.90700000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76000000000000001,"15min":0.752},"min":{"1min":0.66400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.90900000000000003,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63300000000000001,"15min":0.64900000000000002},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.79000000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68999999999999995,"15min":0.71699999999999997},"min":{"1min":0.41499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84499999999999997,"5min":1.018,"15min":1.018},"last":0.65800000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.621,"15min":0.629},"min":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75600000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.505,"15min":0.505},"max":{"1min":0.82399999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.79100000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.72899999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.88900000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":0.82399999999999995,"5min":1.55,"15min":1.55},"last":0.76300000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302028,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069812,"statfs":{"total":96636764160,"available":96327487488,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.40600000000000003,"15min":0.40000000000000002},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59299999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46899999999999997},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64900000000000002,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.53300000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.371,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63200000000000001,"5min":1.024,"15min":1.024},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59099999999999997,"15min":0.61299999999999999},"min":{"1min":0.48699999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66300000000000003,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53400000000000003,"15min":0.52600000000000002},"min":{"1min":0.438,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.62,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.75900000000000001,"5min":1.099,"15min":1.099},"last":0.73899999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79000000000000004,"15min":0.78800000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.044,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.77000000000000002},"min":{"1min":0.64400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0269999999999999,"5min":1.248,"15min":1.248},"last":0.97499999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.022,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.80900000000000005},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.98599999999999999,"5min":1.236,"15min":1.236},"last":0.90600000000000003}]},{"osd":6,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.63100000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0760000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.878,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.95399999999999996}]},{"osd":7,"last update":"Sat Aug 17 02:32:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.81499999999999995,"15min":0.81200000000000006},"min":{"1min":0.629,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.101,"5min":1.329,"15min":1.329},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79200000000000004,"15min":0.80200000000000005},"min":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.96799999999999997,"5min":1.377,"15min":1.377},"last":0.85499999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.44600000000000001,"15min":0.45400000000000001},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.57799999999999996,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.47899999999999998,"15min":0.47799999999999998},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64200000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.48699999999999999},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.432,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64300000000000002,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.63900000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.47599999999999998},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64600000000000002,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.76700000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.621}]},{"osd":4,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60799999999999998,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.99399999999999999,"5min":1.29,"15min":1.29},"last":0.995},{"interface":"front","average":{"1min":0.746,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.89000000000000001,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.96299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91700000000000004,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.80000000000000004},"min":{"1min":0.64200000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.93799999999999994,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.92700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96299999999999997,"5min":1.319,"15min":1.319},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78500000000000003,"15min":0.79000000000000004},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0329999999999999,"5min":1.143,"15min":1.143},"last":0.94199999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:32:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.79500000000000004},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.012,"5min":1.389,"15min":1.389},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.97899999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.85999999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302024,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069816,"statfs":{"total":96636764160,"available":96327491584,"internally_reserved":0,"allocated":520192,"data_stored":215752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.442,"15min":0.45300000000000001},"min":{"1min":0.33000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.443},"min":{"1min":0.34699999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.374}]},{"osd":2,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.437,"15min":0.42099999999999999},"min":{"1min":0.36799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.439,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.65200000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.52000000000000002},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.751,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45200000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.054,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.62},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95499999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75,"15min":0.745},"min":{"1min":0.63700000000000001,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93500000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73399999999999999,"15min":0.72099999999999997},"min":{"1min":0.62,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.755,"15min":0.754},"min":{"1min":0.61299999999999999,"5min":0.496,"15min":0.496},"max":{"1min":1.024,"5min":1.03,"15min":1.03},"last":0.747},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.76900000000000002},"min":{"1min":0.61299999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.63800000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:32:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.64600000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.62,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94899999999999995,"5min":1.022,"15min":1.022},"last":0.67500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302600,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069240,"statfs":{"total":96636764160,"available":96326901760,"internally_reserved":0,"allocated":1114112,"data_stored":806120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.32100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61099999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48999999999999999},"min":{"1min":0.45200000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.69599999999999995,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66700000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.39700000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.625,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46000000000000002,"15min":0.46700000000000003},"min":{"1min":0.38900000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.54300000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.45100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71099999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.498}]},{"osd":4,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.56799999999999995,"5min":0.495,"15min":0.495},"max":{"1min":0.87,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71999999999999997,"15min":0.70999999999999996},"min":{"1min":0.54100000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.82899999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.73499999999999999},"min":{"1min":0.64200000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.65900000000000003,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.93700000000000006,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.747}]},{"osd":6,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.747,"15min":0.751},"min":{"1min":0.56399999999999995,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93999999999999995,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.73499999999999999,"15min":0.71899999999999997},"min":{"1min":0.56399999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67800000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:32:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78300000000000003,"15min":0.77300000000000002},"min":{"1min":0.627,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.80300000000000005,"15min":0.80200000000000005},"min":{"1min":0.61399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.96499999999999997,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:33:04.128 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:33:04.270 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.270+0000 7f32f4400640 1 Processor -- start 2024-08-17T02:33:04.271 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.270+0000 7f32f4400640 1 -- start start 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.271+0000 7f32f4400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 0x7f32ec06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.271+0000 7f32f4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec1598f0 con 0x7f32ec0c7db0 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.271+0000 7f32f4400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec159bd0 con 0x7f32ec0c92e0 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.271+0000 7f32f4400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec159eb0 con 0x7f32ec155a80 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f32ec0c7db0 0x7f32ec0c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:53540/0 (socket says 172.21.15.110:53540) 2024-08-17T02:33:04.272 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1000640 1 -- 172.21.15.110:0/2464728429 learned_addr learned my addr 172.21.15.110:0/2464728429 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:33:04.273 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1a00640 1 --2- 172.21.15.110:0/2464728429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 0x7f32ec06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823728287 0 0) 0x7f32ec1598f0 con 0x7f32ec0c7db0 2024-08-17T02:33:04.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d40034e0 con 0x7f32ec0c7db0 2024-08-17T02:33:04.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418136766 0 0) 0x7f32ec159bd0 con 0x7f32ec0c92e0 2024-08-17T02:33:04.274 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32ec1598f0 con 0x7f32ec0c92e0 2024-08-17T02:33:04.275 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1a00640 1 -- 172.21.15.110:0/2464728429 >> v1:172.21.15.177:6789/0 conn(0x7f32ec0c92e0 legacy=0x7f32ec0aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1a00640 1 -- 172.21.15.110:0/2464728429 >> v1:172.21.15.110:6789/0 conn(0x7f32ec0c7db0 legacy=0x7f32ec0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.272+0000 7f32f1a00640 1 -- 172.21.15.110:0/2464728429 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec15a190 con 0x7f32ec155a80 2024-08-17T02:33:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.273+0000 7f32f1a00640 1 --2- 172.21.15.110:0/2464728429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 0x7f32ec06dc00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009880 tx=0x7f32e00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf828387250b2d4d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e002aea0 con 0x7f32ec155a80 2024-08-17T02:33:04.276 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0032440 con 0x7f32ec155a80 2024-08-17T02:33:04.277 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32ebe00640 1 -- 172.21.15.110:0/2464728429 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e00327e0 con 0x7f32ec155a80 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32f4400640 1 -- 172.21.15.110:0/2464728429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 msgr2=0x7f32ec06dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32f4400640 1 --2- 172.21.15.110:0/2464728429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 0x7f32ec06dc00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32e0009880 tx=0x7f32e00090f0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32f4400640 1 -- 172.21.15.110:0/2464728429 shutdown_connections 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32f4400640 1 --2- 172.21.15.110:0/2464728429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec155a80 0x7f32ec06dc00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.274+0000 7f32f4400640 1 -- 172.21.15.110:0/2464728429 >> 172.21.15.110:0/2464728429 conn(0x7f32ec067750 msgr2=0x7f32ec0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.275+0000 7f32f4400640 1 -- 172.21.15.110:0/2464728429 shutdown_connections 2024-08-17T02:33:04.280 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.275+0000 7f32f4400640 1 -- 172.21.15.110:0/2464728429 wait complete. 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.276+0000 7f32f4400640 1 Processor -- start 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.276+0000 7f32f4400640 1 -- start start 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0c7db0 0x7f32ec148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec0c92e0 0x7f32ec0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec147370 con 0x7f32ec155a80 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec146510 con 0x7f32ec0c92e0 2024-08-17T02:33:04.281 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f4400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec146760 con 0x7f32ec0c7db0 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f2400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f2400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53818/0 (socket says 172.21.15.110:53818) 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f2400640 1 -- 172.21.15.110:0/968487456 learned_addr learned my addr 172.21.15.110:0/968487456 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f1a00640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0c7db0 0x7f32ec148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.277+0000 7f32f1000640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec0c92e0 0x7f32ec0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 -- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0c7db0 msgr2=0x7f32ec148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.282 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0c7db0 0x7f32ec148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 -- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec0c92e0 msgr2=0x7f32ec0a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec0c92e0 0x7f32ec0a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 -- 172.21.15.110:0/968487456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009390 con 0x7f32ec155a80 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f2400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c810 tx=0x7f32e40026f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400ce00 con 0x7f32ec155a80 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e400a850 con 0x7f32ec155a80 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec146a40 con 0x7f32ec155a80 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.278+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400ac90 con 0x7f32ec155a80 2024-08-17T02:33:04.283 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.279+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec147000 con 0x7f32ec155a80 2024-08-17T02:33:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.279+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec147520 con 0x7f32ec155a80 2024-08-17T02:33:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.280+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f32e4012630 con 0x7f32ec155a80 2024-08-17T02:33:04.284 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.281+0000 7f32e8c00640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 0x7f32cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.281+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f32e40824b0 con 0x7f32ec155a80 2024-08-17T02:33:04.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.281+0000 7f32f1a00640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 0x7f32cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.282+0000 7f32f1a00640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 0x7f32cc067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e0032000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.285 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.285+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f32ec147520 con 0x7f32ec155a80 2024-08-17T02:33:04.456 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.455+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f32ec147520 con 0x7f32ec155a80 2024-08-17T02:33:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.460+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f32e4050820 con 0x7f32ec155a80 2024-08-17T02:33:04.460 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.460+0000 7f32e8c00640 1 -- 172.21.15.110:0/968487456 <== mon.0 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f32ec147520 con 0x7f32ec155a80 2024-08-17T02:33:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 msgr2=0x7f32cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 0x7f32cc067600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32e0034000 tx=0x7f32e0032000 comp rx=0 tx=0).stop 2024-08-17T02:33:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 msgr2=0x7f32ec157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.463 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c810 tx=0x7f32e40026f0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 shutdown_connections 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f32cc065150 0x7f32cc067600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32ec155a80 0x7f32ec157740 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec0c92e0 0x7f32ec0a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.462+0000 7f32f4400640 1 --2- 172.21.15.110:0/968487456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0c7db0 0x7f32ec148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.463+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 >> 172.21.15.110:0/968487456 conn(0x7f32ec067750 msgr2=0x7f32ec068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.463+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 shutdown_connections 2024-08-17T02:33:04.464 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.463+0000 7f32f4400640 1 -- 172.21.15.110:0/968487456 wait complete. 2024-08-17T02:33:04.479 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:33:04.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:33:04.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.628+0000 7f2e4e200640 1 Processor -- start 2024-08-17T02:33:04.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.628+0000 7f2e4e200640 1 -- start start 2024-08-17T02:33:04.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.629+0000 7f2e4e200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e480cc010 0x7f2e480ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4e200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e4815c7c0 0x7f2e4815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4e200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e480ab950 con 0x7f2e480a98e0 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4e200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480abc30 con 0x7f2e4815c7c0 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4e200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e480abf10 con 0x7f2e480cc010 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4d800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e4815c7c0 0x7f2e4815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e3fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2e480a98e0 0x7f2e480afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:53556/0 (socket says 172.21.15.110:53556) 2024-08-17T02:33:04.631 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e3fe00640 1 -- 172.21.15.110:0/3395029248 learned_addr learned my addr 172.21.15.110:0/3395029248 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4ce00640 1 --2- 172.21.15.110:0/3395029248 >> v2:172.21.15.177:3300/0 conn(0x7f2e480cc010 0x7f2e480ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4d800640 1 -- 172.21.15.110:0/3395029248 >> v2:172.21.15.177:3300/0 conn(0x7f2e480cc010 msgr2=0x7f2e480ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4d800640 1 --2- 172.21.15.110:0/3395029248 >> v2:172.21.15.177:3300/0 conn(0x7f2e480cc010 0x7f2e480ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4d800640 1 -- 172.21.15.110:0/3395029248 >> v1:172.21.15.110:6789/0 conn(0x7f2e480a98e0 legacy=0x7f2e480afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e4d800640 1 -- 172.21.15.110:0/3395029248 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e480af970 con 0x7f2e4815c7c0 2024-08-17T02:33:04.632 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.630+0000 7f2e47e00640 1 -- 172.21.15.110:0/3395029248 <== mon.0 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259566500 0 0) 0x7f2e480ab950 con 0x7f2e480a98e0 2024-08-17T02:33:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.631+0000 7f2e4d800640 1 --2- 172.21.15.110:0/3395029248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4815c7c0 0x7f2e4815cc00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2e48064c30 tx=0x7f2e40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0a569c714fcd29 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e47e00640 1 -- 172.21.15.110:0/3395029248 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40007550 con 0x7f2e4815c7c0 2024-08-17T02:33:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e47e00640 1 -- 172.21.15.110:0/3395029248 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2e4002d050 con 0x7f2e4815c7c0 2024-08-17T02:33:04.634 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e47e00640 1 -- 172.21.15.110:0/3395029248 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40007900 con 0x7f2e4815c7c0 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 -- 172.21.15.110:0/3395029248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4815c7c0 msgr2=0x7f2e4815cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3395029248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4815c7c0 0x7f2e4815cc00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2e48064c30 tx=0x7f2e40009780 comp rx=0 tx=0).stop 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 -- 172.21.15.110:0/3395029248 shutdown_connections 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3395029248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e4815c7c0 0x7f2e4815cc00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3395029248 >> v2:172.21.15.177:3300/0 conn(0x7f2e480cc010 0x7f2e480ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 -- 172.21.15.110:0/3395029248 >> 172.21.15.110:0/3395029248 conn(0x7f2e48067de0 msgr2=0x7f2e480681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:04.635 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 -- 172.21.15.110:0/3395029248 shutdown_connections 2024-08-17T02:33:04.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.632+0000 7f2e4e200640 1 -- 172.21.15.110:0/3395029248 wait complete. 2024-08-17T02:33:04.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.634+0000 7f2e4e200640 1 Processor -- start 2024-08-17T02:33:04.636 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.634+0000 7f2e4e200640 1 -- start start 2024-08-17T02:33:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 0x7f2e480ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 0x7f2e481564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48151630 con 0x7f2e480cc010 2024-08-17T02:33:04.638 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e480aceb0 con 0x7f2e4815c7c0 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4e200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e48169150 con 0x7f2e480a98e0 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53830/0 (socket says 172.21.15.110:53830) 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 -- 172.21.15.110:0/3810022707 learned_addr learned my addr 172.21.15.110:0/3810022707 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4ce00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 0x7f2e480ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4d800640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 0x7f2e481564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.639 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 -- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 msgr2=0x7f2e480ad970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 0x7f2e480ad970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 -- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 msgr2=0x7f2e481564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 0x7f2e481564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e3fe00640 1 -- 172.21.15.110:0/3810022707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009a20 con 0x7f2e480cc010 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4d800640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 0x7f2e481564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.635+0000 7f2e4ce00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 0x7f2e480ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:33:04.640 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e3fe00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c510 tx=0x7f2e3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30005aa0 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2e30005c00 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480ad150 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e300070d0 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.636+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e481696f0 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.637+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e48169910 con 0x7f2e480cc010 2024-08-17T02:33:04.641 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.638+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e300074c0 con 0x7f2e480cc010 2024-08-17T02:33:04.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.638+0000 7f2e44c00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 0x7f2e24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:33:04.642 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.638+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f2e300817a0 con 0x7f2e480cc010 2024-08-17T02:33:04.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.639+0000 7f2e4ce00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 0x7f2e24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:33:04.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.639+0000 7f2e4ce00640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 0x7f2e24067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bb80 tx=0x7f2e38008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:33:04.643 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.642+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e3004fae0 con 0x7f2e480cc010 2024-08-17T02:33:04.853 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.852+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e48071050 con 0x7f2e480cc010 2024-08-17T02:33:04.854 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.853+0000 7f2e44c00640 1 -- 172.21.15.110:0/3810022707 <== mon.0 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f2e30017090 con 0x7f2e480cc010 2024-08-17T02:33:04.854 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-08-17T02:33:04.854 INFO:teuthology.orchestra.run.smithi110.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1159982682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6836","nonce":1159982682},{"type":"v1","addr":"172.21.15.110:6837","nonce":1159982682}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4900,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/4146090484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":4146090484},{"type":"v1","addr":"172.21.15.177:6835","nonce":4146090484}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/112137503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":112137503},{"type":"v1","addr":"172.21.15.177:6834","nonce":112137503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5301,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1057905272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1057905272},{"type":"v1","addr":"172.21.15.110:6835","nonce":1057905272}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[]} 2024-08-17T02:33:04.855 INFO:teuthology.orchestra.run.smithi110.stderr:dumped fsmap epoch 25 2024-08-17T02:33:04.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 msgr2=0x7f2e24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 0x7f2e24067600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800bb80 tx=0x7f2e38008040 comp rx=0 tx=0).stop 2024-08-17T02:33:04.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 msgr2=0x7f2e48169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:33:04.856 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000c510 tx=0x7f2e3000c910 comp rx=0 tx=0).stop 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 shutdown_connections 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:6832/36835,v1:172.21.15.110:6833/36835] conn(0x7f2e24065150 0x7f2e24067600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4815c7c0 0x7f2e481564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e480cc010 0x7f2e48169c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 --2- 172.21.15.110:0/3810022707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e480a98e0 0x7f2e480ad970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.855+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 >> 172.21.15.110:0/3810022707 conn(0x7f2e48067de0 msgr2=0x7f2e480681b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:33:04.857 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.856+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 shutdown_connections 2024-08-17T02:33:04.858 INFO:teuthology.orchestra.run.smithi110.stderr:2024-08-17T02:33:04.856+0000 7f2e4e200640 1 -- 172.21.15.110:0/3810022707 wait complete. 2024-08-17T02:33:04.872 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:33:04.872 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:33:04.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:33:04.872 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:04.885 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:33:04.885 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:33:04.885 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:04.939 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:33:04.940 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:33:04.940 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:04.956 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:33:04.956 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:33:04.956 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.012 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:33:05.013 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:33:05.013 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:33:05.013 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.053 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:33:05.053 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:33:05.053 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.147 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:33:05.147 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:33:05.147 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.200 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:33:05.201 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:33:05.201 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.245 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:33:05.246 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:33:05.246 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.293 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:33:05.294 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:33:05.294 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.352 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:33:05.352 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:33:05.352 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.414 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:33:05.415 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:33:05.415 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.467 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:33:05.467 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:33:05.467 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:33:05.467 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.527 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:33:05.528 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:33:05.528 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.585 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:33:05.585 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:33:05.586 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:33:05.586 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.605 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:33:05.605 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:33:05.605 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.623 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:33:05.623 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:33:05.623 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:33:05.681 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:33:05.682 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:33:05.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:33:05.756 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:33:05.756 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:33:05.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:33:05.983 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:33:06.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:33:06.086 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:33:06.187 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:33:06.187 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:33:06.284 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:33:06.316 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:33:06.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:33:06.503 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:33:06.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:33:06.607 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:33:06.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:33:06.706 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:33:06.835 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:33:06.836 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/data/mon.a.tgz 2024-08-17T02:33:06.837 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-08-17T02:33:06.872 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.eTaqHRigBo 2024-08-17T02:33:06.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eTaqHRigBo 2024-08-17T02:33:07.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.eTaqHRigBo 2024-08-17T02:33:07.150 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.eTaqHRigBo is 309KB 2024-08-17T02:33:07.239 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.eTaqHRigBo 2024-08-17T02:33:07.273 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/data/mon.b.tgz 2024-08-17T02:33:07.274 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-08-17T02:33:07.309 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.AWOtRfGKkl 2024-08-17T02:33:07.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.AWOtRfGKkl 2024-08-17T02:33:07.503 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.AWOtRfGKkl 2024-08-17T02:33:07.597 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.AWOtRfGKkl is 407KB 2024-08-17T02:33:07.685 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.AWOtRfGKkl 2024-08-17T02:33:07.720 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/data/mon.c.tgz 2024-08-17T02:33:07.720 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-08-17T02:33:07.794 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.LqX07llGvp 2024-08-17T02:33:07.795 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LqX07llGvp 2024-08-17T02:33:07.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.LqX07llGvp 2024-08-17T02:33:08.068 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.LqX07llGvp is 407KB 2024-08-17T02:33:08.158 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.LqX07llGvp 2024-08-17T02:33:08.192 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:33:08.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:33:08.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:33:08.287 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:33:08.288 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:33:08.292 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:33:08.351 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:33:08.353 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:33:08.364 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:33:08.365 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi110/crash 2024-08-17T02:33:08.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:33:08.420 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi177/crash 2024-08-17T02:33:08.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:33:08.474 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:33:08.475 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:33:08.479 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:33:08.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:33:08.622 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:33:08.677 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:33:08.677 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:33:08.681 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:33:08.731 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2024-08-17T02:33:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44462.log 2024-08-17T02:33:08.732 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43115.log 2024-08-17T02:33:08.733 INFO:teuthology.orchestra.run.smithi110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2024-08-17T02:33:08.733 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.2.44462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44462.log.gz 2024-08-17T02:33:08.733 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-08-17T02:33:08.734 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-08-17T02:33:08.734 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43115.log.gz 2024-08-17T02:33:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42459.log 2024-08-17T02:33:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37215.log 2024-08-17T02:33:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.42459.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:33:08.736 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42459.log.gz 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48487.log 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.37218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48697.log 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-08-17T02:33:08.738 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2024-08-17T02:33:08.739 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48487.log.gz 2024-08-17T02:33:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43178.log 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37215.log.gz 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.43178.log: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.1.43178.log.gz --verbose 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-client.3.42780.log 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:33:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.42780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42780.log.gz 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.7.log: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37255.log 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37255.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:33:08.748 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37255.log.gz 2024-08-17T02:33:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37415.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-08-17T02:33:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37375.log 2024-08-17T02:33:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37124.log 2024-08-17T02:33:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37375.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37375.log.gz 2024-08-17T02:33:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:33:08.755 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37124.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:33:08.755 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37124.log.gz 2024-08-17T02:33:08.755 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37335.log 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37295.log 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37335.log.gz 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37295.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:33:08.756 INFO:teuthology.orchestra.run.smithi177.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37295.log.gz 2024-08-17T02:33:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37164.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:33:08.757 INFO:teuthology.orchestra.run.smithi177.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-08-17T02:33:08.759 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-08-17T02:33:08.759 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48697.log.gz 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49220.log 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2024-08-17T02:33:08.760 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49430.log 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49220.log.gz 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49430.log.gz 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2024-08-17T02:33:08.761 INFO:teuthology.orchestra.run.smithi110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43493.log 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49094.log 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43493.log.gz 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-08-17T02:33:08.762 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49094.log.gz 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42783.log 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41753.log 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42783.log.gz 2024-08-17T02:33:08.763 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45346.log 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41753.log.gz 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49556.log 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48529.log 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45346.log.gz 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49556.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49556.log.gz 2024-08-17T02:33:08.764 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48529.log.gz 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48613.log 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49924.log: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49346.log 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43535.log 2024-08-17T02:33:08.765 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48613.log.gz 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44162.log 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49346.log.gz 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43535.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43535.log.gz 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-08-17T02:33:08.766 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44162.log.gz 2024-08-17T02:33:08.771 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50428.log 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49798.log 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46668.log 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50428.log.gz 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49798.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.49798.log.gz --verbose 2024-08-17T02:33:08.772 INFO:teuthology.orchestra.run.smithi110.stderr: -- /var/log/ceph/ceph-client.admin.50260.log 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43283.log 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46668.log.gz 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50260.log.gz 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40930.log 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43283.log.gz 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43157.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2024-08-17T02:33:08.773 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50554.log 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.40930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40930.log.gz 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50554.log.gz 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46170.log 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44716.log 2024-08-17T02:33:08.774 INFO:teuthology.orchestra.run.smithi110.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-08-17T02:33:08.775 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46170.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:33:08.775 INFO:teuthology.orchestra.run.smithi110.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46170.log.gz 2024-08-17T02:33:08.777 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45834.log 2024-08-17T02:33:08.777 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44716.log.gz 2024-08-17T02:33:08.777 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41795.log 2024-08-17T02:33:08.777 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45834.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49966.log 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45834.log.gz 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41795.log.gz 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49966.log.gz 2024-08-17T02:33:08.778 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41855.log 2024-08-17T02:33:08.779 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47019.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2024-08-17T02:33:08.780 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42115.log 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41855.log.gz 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2024-08-17T02:33:08.781 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42115.log.gz 2024-08-17T02:33:08.782 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46086.log 2024-08-17T02:33:08.782 INFO:teuthology.orchestra.run.smithi110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-08-17T02:33:08.783 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43619.log 2024-08-17T02:33:08.783 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2024-08-17T02:33:08.783 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2024-08-17T02:33:08.784 INFO:teuthology.orchestra.run.smithi110.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46086.log.gz 2024-08-17T02:33:08.785 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42777.log 2024-08-17T02:33:08.785 INFO:teuthology.orchestra.run.smithi110.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43619.log.gz 2024-08-17T02:33:08.785 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46128.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:33:08.785 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2024-08-17T02:33:08.786 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48655.log 2024-08-17T02:33:08.786 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42777.log.gz 2024-08-17T02:33:08.787 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2024-08-17T02:33:08.787 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-08-17T02:33:08.787 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48655.log.gz 2024-08-17T02:33:08.788 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45094.log 2024-08-17T02:33:08.789 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2024-08-17T02:33:08.789 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-08-17T02:33:08.789 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2024-08-17T02:33:08.790 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2024-08-17T02:33:08.791 INFO:teuthology.orchestra.run.smithi110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45094.log.gz 2024-08-17T02:33:08.791 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47061.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2024-08-17T02:33:08.792 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-08-17T02:33:08.792 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47959.log 2024-08-17T02:33:08.793 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:33:08.794 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2024-08-17T02:33:08.794 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48739.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-08-17T02:33:08.794 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:33:08.795 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42449.log 2024-08-17T02:33:08.795 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47959.log.gz 2024-08-17T02:33:08.795 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2024-08-17T02:33:08.796 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42449.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:33:08.797 INFO:teuthology.orchestra.run.smithi110.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42449.log.gz 2024-08-17T02:33:08.797 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2024-08-17T02:33:08.798 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-08-17T02:33:08.798 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2024-08-17T02:33:08.799 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2024-08-17T02:33:08.799 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2024-08-17T02:33:08.800 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46458.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz 2024-08-17T02:33:08.800 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:33:08.801 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47146.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:33:08.801 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2024-08-17T02:33:08.802 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45052.log 2024-08-17T02:33:08.803 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49052.log 2024-08-17T02:33:08.804 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45052.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:33:08.805 INFO:teuthology.orchestra.run.smithi110.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45052.log.gz 2024-08-17T02:33:08.806 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49052.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30766.log 2024-08-17T02:33:08.806 INFO:teuthology.orchestra.run.smithi110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49052.log.gz 2024-08-17T02:33:08.807 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2024-08-17T02:33:08.808 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.tmp-client.admin.30766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45606.log 2024-08-17T02:33:08.808 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30766.log.gz 2024-08-17T02:33:08.809 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2024-08-17T02:33:08.810 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2024-08-17T02:33:08.811 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50738.log 2024-08-17T02:33:08.811 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45606.log.gz 2024-08-17T02:33:08.812 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-08-17T02:33:08.812 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2024-08-17T02:33:08.814 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42450.log 2024-08-17T02:33:08.814 INFO:teuthology.orchestra.run.smithi110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50738.log.gz 2024-08-17T02:33:08.815 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44632.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-08-17T02:33:08.815 INFO:teuthology.orchestra.run.smithi110.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45178.log 2024-08-17T02:33:08.816 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42450.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2024-08-17T02:33:08.816 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42450.log.gz 2024-08-17T02:33:08.817 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41353.log 2024-08-17T02:33:08.818 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45178.log.gz 2024-08-17T02:33:08.819 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43241.log 2024-08-17T02:33:08.819 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz 2024-08-17T02:33:08.820 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41353.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41353.log.gz 2024-08-17T02:33:08.821 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43241.log.gz 2024-08-17T02:33:08.822 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45136.log 2024-08-17T02:33:08.823 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2024-08-17T02:33:08.824 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47282.log 2024-08-17T02:33:08.825 INFO:teuthology.orchestra.run.smithi110.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45136.log.gz 2024-08-17T02:33:08.826 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43031.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2024-08-17T02:33:08.827 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47282.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47282.log.gz 2024-08-17T02:33:08.827 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48149.log 2024-08-17T02:33:08.828 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-08-17T02:33:08.830 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48149.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:33:08.830 INFO:teuthology.orchestra.run.smithi110.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.48149.log.gz 2024-08-17T02:33:08.831 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41627.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-08-17T02:33:08.834 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2024-08-17T02:33:08.835 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46373.log 2024-08-17T02:33:08.837 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46415.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2024-08-17T02:33:08.837 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48883.log 2024-08-17T02:33:08.838 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2024-08-17T02:33:08.840 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48883.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46373.log.gz 2024-08-17T02:33:08.840 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48883.log.gz 2024-08-17T02:33:08.841 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-08-17T02:33:08.842 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45918.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-08-17T02:33:08.844 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42448.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-08-17T02:33:08.844 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46002.log 2024-08-17T02:33:08.846 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41711.log 2024-08-17T02:33:08.847 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46002.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46002.log.gz 2024-08-17T02:33:08.849 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41711.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41711.log.gz 2024-08-17T02:33:08.849 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2024-08-17T02:33:08.850 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44842.log 2024-08-17T02:33:08.852 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44968.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2024-08-17T02:33:08.853 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44842.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44842.log.gz 2024-08-17T02:33:08.853 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46044.log 2024-08-17T02:33:08.855 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50344.log 2024-08-17T02:33:08.856 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46044.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46044.log.gz 2024-08-17T02:33:08.858 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50344.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50344.log.gz 2024-08-17T02:33:08.858 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50470.log 2024-08-17T02:33:08.860 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2024-08-17T02:33:08.860 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:33:08.861 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-08-17T02:33:08.861 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50470.log.gz 2024-08-17T02:33:08.862 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45262.log 2024-08-17T02:33:08.862 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2024-08-17T02:33:08.863 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50176.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-08-17T02:33:08.863 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-08-17T02:33:08.865 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50218.log 2024-08-17T02:33:08.865 INFO:teuthology.orchestra.run.smithi110.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45262.log.gz 2024-08-17T02:33:08.866 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.36833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-08-17T02:33:08.866 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-08-17T02:33:08.867 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50218.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50218.log.gz 2024-08-17T02:33:08.867 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44884.log 2024-08-17T02:33:08.869 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.45960.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-08-17T02:33:08.869 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-08-17T02:33:08.869 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44884.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44884.log.gz 2024-08-17T02:33:08.870 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41585.log 2024-08-17T02:33:08.871 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42457.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-08-17T02:33:08.871 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50302.log 2024-08-17T02:33:08.872 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2024-08-17T02:33:08.873 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41585.log.gz 2024-08-17T02:33:08.873 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50302.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50302.log.gz 2024-08-17T02:33:08.874 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48571.log 2024-08-17T02:33:08.875 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41026.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2024-08-17T02:33:08.875 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44506.log 2024-08-17T02:33:08.876 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50596.log 2024-08-17T02:33:08.877 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48571.log.gz 2024-08-17T02:33:08.878 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-08-17T02:33:08.878 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44506.log.gz 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49388.log 2024-08-17T02:33:08.879 INFO:teuthology.orchestra.run.smithi110.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50596.log.gz 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2024-08-17T02:33:08.880 INFO:teuthology.orchestra.run.smithi110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-08-17T02:33:08.882 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50638.log 2024-08-17T02:33:08.882 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49388.log.gz 2024-08-17T02:33:08.882 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:33:08.883 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43451.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz 2024-08-17T02:33:08.883 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45750.log 2024-08-17T02:33:08.884 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50638.log.gz 2024-08-17T02:33:08.884 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42453.log 2024-08-17T02:33:08.885 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.45750.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2024-08-17T02:33:08.886 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45750.log.gz 2024-08-17T02:33:08.886 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42453.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2024-08-17T02:33:08.887 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47746.log 2024-08-17T02:33:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43367.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2024-08-17T02:33:08.888 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50780.log 2024-08-17T02:33:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41501.log 2024-08-17T02:33:08.889 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.47746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47746.log.gz 2024-08-17T02:33:08.890 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46840.log 2024-08-17T02:33:08.891 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50780.log.gz 2024-08-17T02:33:08.891 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41501.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41501.log.gz 2024-08-17T02:33:08.892 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2024-08-17T02:33:08.893 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41543.log 2024-08-17T02:33:08.893 INFO:teuthology.orchestra.run.smithi110.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46840.log.gz 2024-08-17T02:33:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47559.log 2024-08-17T02:33:08.895 INFO:teuthology.orchestra.run.smithi110.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2024-08-17T02:33:08.895 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41543.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41543.log.gz 2024-08-17T02:33:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45792.log 2024-08-17T02:33:08.896 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2024-08-17T02:33:08.897 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47559.log.gz/var/log/ceph/ceph-client.admin.45792.log: 2024-08-17T02:33:08.898 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.47367.log 2024-08-17T02:33:08.898 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45792.log.gz 2024-08-17T02:33:08.900 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-08-17T02:33:08.900 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2024-08-17T02:33:08.901 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47367.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41459.log 2024-08-17T02:33:08.901 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-08-17T02:33:08.902 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2024-08-17T02:33:08.902 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-08-17T02:33:08.903 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41459.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41459.log.gz 2024-08-17T02:33:08.904 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49514.log 2024-08-17T02:33:08.904 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2024-08-17T02:33:08.905 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41939.log 2024-08-17T02:33:08.906 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2024-08-17T02:33:08.907 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49514.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49514.log.gz 2024-08-17T02:33:08.907 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2024-08-17T02:33:08.907 INFO:teuthology.orchestra.run.smithi110.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41939.log.gz 2024-08-17T02:33:08.908 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46796.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2024-08-17T02:33:08.909 INFO:teuthology.orchestra.run.smithi177.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:33:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45388.log 2024-08-17T02:33:08.909 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2024-08-17T02:33:08.910 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2024-08-17T02:33:08.911 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45388.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45388.log.gz 2024-08-17T02:33:08.911 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41669.log 2024-08-17T02:33:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48926.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2024-08-17T02:33:08.912 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2024-08-17T02:33:08.914 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2024-08-17T02:33:08.914 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41669.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41669.log.gz 2024-08-17T02:33:08.915 INFO:teuthology.orchestra.run.smithi177.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:33:08.915 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41293.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-08-17T02:33:08.915 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41407.log 2024-08-17T02:33:08.916 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45304.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2024-08-17T02:33:08.917 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-08-17T02:33:08.918 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41407.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41407.log.gz 2024-08-17T02:33:08.918 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2024-08-17T02:33:08.919 INFO:teuthology.orchestra.run.smithi110.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:33:08.919 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.46752.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2024-08-17T02:33:08.920 INFO:teuthology.orchestra.run.smithi110.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-08-17T02:33:08.920 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49262.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2024-08-17T02:33:08.920 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42120.log 2024-08-17T02:33:08.921 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.46250.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42456.log 2024-08-17T02:33:08.922 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6%/var/log/ceph/ceph-client.admin.42120.log: -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2024-08-17T02:33:08.922 INFO:teuthology.orchestra.run.smithi110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42120.log.gz 2024-08-17T02:33:08.922 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-08-17T02:33:08.923 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44800.log 2024-08-17T02:33:08.924 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42456.log.gz 2024-08-17T02:33:08.924 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43073.log 2024-08-17T02:33:08.924 INFO:teuthology.orchestra.run.smithi110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-08-17T02:33:08.925 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48361.log 2024-08-17T02:33:08.926 INFO:teuthology.orchestra.run.smithi110.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44800.log.gz 2024-08-17T02:33:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43073.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43073.log.gz 2024-08-17T02:33:08.926 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48023.log 2024-08-17T02:33:08.927 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2024-08-17T02:33:08.928 INFO:teuthology.orchestra.run.smithi110.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48361.log.gz 2024-08-17T02:33:08.928 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48023.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-08-17T02:33:08.929 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48023.log.gz 2024-08-17T02:33:08.929 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42444.log 2024-08-17T02:33:08.930 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2024-08-17T02:33:08.931 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43325.log 2024-08-17T02:33:08.931 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-08-17T02:33:08.932 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:33:08.933 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42779.log 2024-08-17T02:33:08.933 INFO:teuthology.orchestra.run.smithi110.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2024-08-17T02:33:08.933 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43325.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43325.log.gz 2024-08-17T02:33:08.933 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44758.log 2024-08-17T02:33:08.934 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42793.log 2024-08-17T02:33:08.935 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44758.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42779.log.gz 2024-08-17T02:33:08.935 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2024-08-17T02:33:08.936 INFO:teuthology.orchestra.run.smithi110.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44758.log.gz 2024-08-17T02:33:08.936 INFO:teuthology.orchestra.run.smithi177.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:33:08.937 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2024-08-17T02:33:08.938 INFO:teuthology.orchestra.run.smithi110.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42793.log.gz 2024-08-17T02:33:08.938 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48445.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2024-08-17T02:33:08.938 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42117.log 2024-08-17T02:33:08.938 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.41897.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49882.log 2024-08-17T02:33:08.939 INFO:teuthology.orchestra.run.smithi110.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz/var/log/ceph/ceph-client.admin.42117.log: 2024-08-17T02:33:08.940 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42117.log.gz 2024-08-17T02:33:08.940 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41236.log 2024-08-17T02:33:08.941 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41194.log 2024-08-17T02:33:08.941 INFO:teuthology.orchestra.run.smithi110.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49882.log.gz 2024-08-17T02:33:08.942 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41236.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41236.log.gz 2024-08-17T02:33:08.942 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2024-08-17T02:33:08.943 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:33:08.944 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.41194.log: 88.1%/var/log/ceph/ceph-client.admin.47917.log: -- replaced with /var/log/ceph/ceph-client.admin.41194.log.gz 2024-08-17T02:33:08.944 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2024-08-17T02:33:08.944 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42109.log 2024-08-17T02:33:08.945 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46710.log 2024-08-17T02:33:08.946 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.42109.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42109.log.gz 2024-08-17T02:33:08.946 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37115.log 2024-08-17T02:33:08.947 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42100.log 2024-08-17T02:33:08.947 INFO:teuthology.orchestra.run.smithi177.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:33:08.948 INFO:teuthology.orchestra.run.smithi110.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46710.log.gz 2024-08-17T02:33:08.949 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.37115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37115.log.gz 2024-08-17T02:33:08.949 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48319.log 2024-08-17T02:33:08.950 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42100.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42100.log.gz 2024-08-17T02:33:08.950 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46890.log 2024-08-17T02:33:08.951 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-08-17T02:33:08.951 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m0.237s 2024-08-17T02:33:08.951 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m1.009s 2024-08-17T02:33:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.166s 2024-08-17T02:33:08.952 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48065.log 2024-08-17T02:33:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48319.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48319.log.gz 2024-08-17T02:33:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46890.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46890.log.gz 2024-08-17T02:33:08.953 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-08-17T02:33:08.954 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48065.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48065.log.gz 2024-08-17T02:33:08.954 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48107.log 2024-08-17T02:33:08.955 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44098.log 2024-08-17T02:33:08.956 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.42686.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-08-17T02:33:08.956 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48107.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48107.log.gz 2024-08-17T02:33:08.957 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50092.log 2024-08-17T02:33:08.957 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.0.44098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44098.log.gz 2024-08-17T02:33:08.958 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-08-17T02:33:08.959 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49598.log 2024-08-17T02:33:08.960 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50092.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50092.log.gz 2024-08-17T02:33:08.960 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43199.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-08-17T02:33:08.961 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48781.log 2024-08-17T02:33:08.962 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49598.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49598.log.gz 2024-08-17T02:33:08.962 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2024-08-17T02:33:08.963 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50512.log 2024-08-17T02:33:08.964 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.48781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48781.log.gz 2024-08-17T02:33:08.964 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49304.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2024-08-17T02:33:08.965 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-08-17T02:33:08.966 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50512.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50512.log.gz 2024-08-17T02:33:08.966 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-08-17T02:33:08.967 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-08-17T02:33:08.968 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47409.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-08-17T02:33:08.968 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45010.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-08-17T02:33:08.969 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47833.log 2024-08-17T02:33:08.969 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-08-17T02:33:08.970 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2024-08-17T02:33:08.971 INFO:teuthology.orchestra.run.smithi110.stderr:gzip/var/log/ceph/ceph-client.admin.47833.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45220.log 2024-08-17T02:33:08.972 INFO:teuthology.orchestra.run.smithi110.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47833.log.gz 2024-08-17T02:33:08.972 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49472.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2024-08-17T02:33:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2024-08-17T02:33:08.973 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45220.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45220.log.gz 2024-08-17T02:33:08.974 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46626.log 2024-08-17T02:33:08.975 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2024-08-17T02:33:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46932.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2024-08-17T02:33:08.976 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.46626.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46626.log.gz 2024-08-17T02:33:08.977 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2024-08-17T02:33:08.978 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.44926.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2024-08-17T02:33:08.978 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50698.log 2024-08-17T02:33:08.979 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2024-08-17T02:33:08.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49840.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2024-08-17T02:33:08.980 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.50698.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50698.log.gz 2024-08-17T02:33:08.981 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49178.log 2024-08-17T02:33:08.982 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47103.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2024-08-17T02:33:08.982 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45472.log 2024-08-17T02:33:08.983 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-08-17T02:33:08.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.49178.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49178.log.gz 2024-08-17T02:33:08.984 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.45472.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45472.log.gz 2024-08-17T02:33:08.985 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43409.log 2024-08-17T02:33:08.986 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.47791.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-08-17T02:33:08.987 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.43409.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43409.log.gz 2024-08-17T02:33:08.990 INFO:teuthology.orchestra.run.smithi110.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:33:09.011 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:33:09.017 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:33:09.038 INFO:teuthology.orchestra.run.smithi110.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:33:09.114 INFO:teuthology.orchestra.run.smithi110.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:33:09.118 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-08-17T02:33:09.118 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m0.408s 2024-08-17T02:33:09.118 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m1.179s 2024-08-17T02:33:09.118 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.644s 2024-08-17T02:33:09.119 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:33:09.119 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi110/log 2024-08-17T02:33:09.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:33:09.497 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi177/log 2024-08-17T02:33:09.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:33:09.680 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:33:09.693 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:33:09.693 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:33:09.698 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:33:09.811 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:33:09.822 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:33:09.823 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:33:09.827 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:33:09.856 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:33:09.861 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:33:09.863 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:33:09.863 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-08-17T02:33:09.863 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv01.front.sepia.ceph.com 3 6 377 4 -57us[ -51us] +/- 62ms 2024-08-17T02:33:09.863 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -71us[ -65us] +/- 64ms 2024-08-17T02:33:09.863 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +191us[ +197us] +/- 64ms 2024-08-17T02:33:09.864 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:33:09.868 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:33:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-08-17T02:33:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -64us[ -49us] +/- 62ms 2024-08-17T02:33:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -43us[ -27us] +/- 64ms 2024-08-17T02:33:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +196us[ +196us] +/- 64ms 2024-08-17T02:33:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:33:09.870 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:33:09.881 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:33:09.881 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:33:09.910 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:33:10.026 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:33:10.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:33:10.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:10.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:33:10.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:10.259 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:33:10.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:33:10.327 INFO:teuthology.task.internal:Duration was 732.410362 seconds 2024-08-17T02:33:10.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:33:10.395 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:33:10.395 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:33:10.399 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:33:10.482 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:33:10.486 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:33:10.914 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:33:10.914 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-08-17T02:33:10.915 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:33:10.963 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-08-17T02:33:10.964 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:33:11.019 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:33:11.019 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:33:11.024 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:33:11.082 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:33:11.082 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:33:11.086 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:33:11.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:33:11.238 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:33:11.238 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:33:11.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:33:11.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:33:11.362 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:33:11.367 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:33:11.433 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-08-17T02:33:11.437 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-08-17T02:33:11.467 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:33:11.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:11.500 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:33:11.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:33:11.534 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:33:11.545 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:33:11.546 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi110 2024-08-17T02:33:11.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:33:11.610 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:10:27-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858284/remote/smithi177 2024-08-17T02:33:11.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:33:11.672 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:33:11.672 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:33:11.677 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:33:11.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:33:11.723 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:33:11.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:33:11.768 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:33:11.769 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:33:11.773 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:33:11.804 INFO:teuthology.orchestra.run.smithi110.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:33 /home/ubuntu/cephtest 2024-08-17T02:33:11.807 INFO:teuthology.orchestra.run.smithi177.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:33 /home/ubuntu/cephtest 2024-08-17T02:33:11.810 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:33:11.821 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:33:11.899 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 732.4103624820709 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=c6019dc92cb1448fad3b71758850a011 status: fail success: false 2024-08-17T02:33:11.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:33:11.969 INFO:teuthology.run:FAIL